Gradio

Massive Text Embedding Benchmark (MTEB) Leaderboard. To submit, refer to the MTEB GitHub repository 🤗 Refer to the MTEB paper for details on metrics, tasks and models.

Total Datasets: 62
Total Languages: 112
Total Scores: >5550
Total Models: 74

Overall MTEB English leaderboard 🔮

Metric: Various, refer to task tabs
Languages: English, refer to task tabs for others

Rank	Model	Embedding Dimensions	Sequence Length	Average (56 datasets)	Classification Average (12 datasets)	Clustering Average (11 datasets)	Pair Classification Average (3 datasets)	Reranking Average (4 datasets)	Retrieval Average (15 datasets)	STS Average (10 datasets)	Summarization Average (1 dataset)
1	e5-large-v2	1024	512	62.25	75.24	44.49	86.03	56.61	50.56	82.05	30.19
2	instructor-xl	768	512	61.79	73.12	44.74	86.62	57.29	49.26	83.06	32.32
3	instructor-large	768	512	61.59	73.86	45.29	85.89	57.54	47.57	83.15	31.84
4	e5-base-v2	768	512	61.5	73.84	43.8	85.73	55.91	50.29	81.05	30.28
5	multilingual-e5-large	1024	514	61.5	74.81	41.06	84.75	55.86	51.43	81.56	29.69
6	e5-large	1024	512	61.42	73.14	43.33	85.94	56.53	49.99	82.06	30.97
7	text-embedding-ada-002	1536	8191	60.99	70.93	45.9	84.89	56.32	49.25	80.97	30.8
8	e5-base	768	512	60.44	72.63	42.11	85.09	55.7	48.75	80.96	31.01
9	e5-small-v2	384	512	59.93	72.94	39.92	84.67	54.32	49.04	80.39	31.16
10	instructor-base	768	512	59.54	72.36	41.9	83.51	56.2	45.12	82.29	29.85
11	sentence-t5-xxl	768	512	59.51	73.42	43.72	85.06	56.42	42.24	82.63	30.08
12	multilingual-e5-base	768	514	59.45	73.02	37.89	83.57	54.84	48.88	80.26	30.11
13	gtr-t5-xxl	768	512	58.97	67.41	42.42	86.12	56.66	48.48	78.38	30.64
14	SGPT-5.8B-weightedmean-msmarco-specb-bitfit	4096	2048	58.93	68.13	40.34	82	56.56	50.25	78.1	31.46
15	e5-small	384	512	58.89	71.67	39.51	85.08	54.45	46.01	80.87	31.39
16	gtr-t5-xl	768	512	58.42	67.11	41.51	86.13	55.96	47.96	77.8	30.21
17	gtr-t5-large	768	512	58.28	67.14	41.6	85.32	55.36	47.42	78.19	29.5
18	multilingual-e5-small	384	512	57.87	70.74	37.08	82.59	53.87	46.64	79.1	29.98
19	sentence-t5-xl	768	512	57.87	72.84	42.34	86.06	54.71	38.47	81.66	29.91
20	all-mpnet-base-v2	768	514	57.78	65.07	43.69	83.04	59.36	43.81	80.28	27.49
21	sgpt-bloom-7b1-msmarco	4096	2048	57.59	66.19	38.93	81.9	55.65	48.22	77.74	33.6
22	SGPT-2.7B-weightedmean-msmarco-specb-bitfit	2560	2048	57.17	67.13	39.83	80.65	54.67	46.54	76.83	31.03
23	sentence-t5-large	768	512	57.06	72.31	41.65	84.97	54	36.71	81.83	29.64
24	all-MiniLM-L12-v2	384	512	56.53	63.21	41.81	82.41	58.44	42.69	79.8	27.9
25	all-MiniLM-L6-v2	384	512	56.26	63.05	42.35	82.37	58.04	41.95	78.9	30.81
26	SGPT-1.3B-weightedmean-msmarco-specb-bitfit	2048	2048	56.2	66.52	39.92	79.58	54	44.49	75.74	30.43
27	gtr-t5-base	768	512	56.19	65.25	38.63	83.85	54.23	44.67	77.07	29.67
28	contriever-base-msmarco	768	512	56	66.68	41.1	82.54	53.14	41.88	76.51	30.36
29	sentence-t5-base	768	512	55.27	69.81	40.21	85.18	53.09	33.63	81.14	31.39
30	paraphrase-multilingual-mpnet-base-v2	768	514	54.71	67.9	38.4	80.81	53.8	35.34	80.73	31.57
31	SGPT-5.8B-weightedmean-nli-bitfit	4096	2048	53.74	70.14	36.98	77.03	52.33	32.34	80.53	30.38
32	paraphrase-multilingual-MiniLM-L12-v2	384	512	52.44	64.3	37.14	78.45	53.62	32.45	78.93	30.67
33	msmarco-bert-co-condensor	768	512	52.35	64.71	37.64	81.74	51.84	32.96	76.47	29.5
34	SGPT-125M-weightedmean-msmarco-specb-bitfit	768	2048	51.25	60.72	35.79	75.23	50.58	37.04	73.41	29.71
35	text-similarity-ada-001	1024	2046	49.52	70.44	37.52	76.86	49.02	18.36	78.6	26.94
36	sup-simcse-bert-base-uncased	768	512	48.87	67.32	33.43	73.68	47.54	21.82	79.12	31.17
37	SGPT-125M-weightedmean-nli-bitfit	768	2048	45.97	61.46	30.95	71.78	47.56	20.9	74.71	30.26
38	unsup-simcse-bert-base-uncased	768	512	45.45	62.5	29.04	70.33	46.47	20.29	74.33	31.15
39	LaBSE	768	512	45.21	62.71	29.55	78.87	48.42	18.99	70.8	31.05
40	komninos	300	N/A	42.06	57.65	26.57	72.94	44.75	21.22	62.46	30.49
41	glove.6B.300d	300	N/A	41.96	57.29	27.73	70.92	43.29	21.62	61.85	28.87
42	allenai-specter	768	512	40.28	52.37	34.06	61.37	48.1	15.88	61.02	27.66
43	bert-base-uncased	768	512	38.33	61.66	30.12	56.33	43.44	10.59	54.36	29.82
44	LASER2	1024	N/A	34.95	53.18	15.28	68.86	41.44	7.94	63.27	26.8
45	cross-en-de-roberta-sentence-transformer	768	514
46	gbert-base	768	512
47	gbert-large	1024	512
48	gelectra-base	768	512
49	gelectra-large	1024	512
50	gottbert-base	768	512
51	text-similarity-babbage-001	2048	2046				77.46
52	text-similarity-curie-001	4096	2046				77.79
53	text-similarity-davinci-001	12288	2046				75.9
54	text-search-ada-doc-001	1024	2046
55	text-search-ada-001	1024	2046
56	text-search-babbage-001	2048	2046
57	text-search-curie-001	4096	2046
58	text-search-davinci-001	12288	2046
59	use-cmlm-multilingual	768	512
60	xlm-roberta-large	1024	514
61	random_embedding	768
62	all-mpnet-base-v2-negation				70.78	40.58	82.15	58.88		79	30.15
63	all-mpnet-base-v2				65.45	43.8	83.04	59.36		80.28	27.49
64	universal-sentence-encoder-multilingual-large-3				65.78	35.06	79.62			75.35	29.71
65	universal-sentence-encoder-multilingual-3				63.42	34.82	75.43			75.39	30.79
66	universal-sentence-encoder-4				64.45	35.71	76.23			72.04	29.42
67	universal-sentence-encoder-large-5				67.9	37.82	79.53			74.05	29.01
68	paraphrase-multilingual-mpnet-base-v2-KE_Sieve				64.85		74.53			75.11
69	LLaMA-embeeding										30.62
70	openai_clip_embeddings
71	text2vec-base-multilingual	384	512		62.23	30.61	76.49			80.24	30.1
72	cai-lunaris-text-embeddings	1024	512					47.85		70.81	29.02
73	cai-stellaris-text-embeddings	768	514		61.44	37.92	82.11	55.24
74	jina-embedding-s-en-v1	512	512		60.12	32.42	78.43	53		77.19	28.96

Classification Leaderboard ❤️

Metric: Accuracy
Languages: English

Model	AmazonCounterfactualClassification (en)	AmazonPolarityClassification	AmazonReviewsClassification (en)	Banking77Classification	EmotionClassification	ImdbClassification	MTOPDomainClassification (en)	MTOPIntentClassification (en)	MassiveIntentClassification (en)	MassiveScenarioClassification (en)	ToxicConversationsClassification	TweetSentimentExtractionClassification
LASER2	76.84	61.01	28.71	57.76	24.83	57.58	75.36	49.47	47.91	55.92	54.05	48.73
LaBSE	75.93	68.95	35.8	69.85	37.22	62.04	86.06	63.03	61.46	66.41	66.9	58.82
all-MiniLM-L12-v2	65.28	62.98	30.79	80.4	41.17	59.76	91.9	62.84	67.15	74.58	67.47	54.25
all-MiniLM-L6-v2	64.15	62.58	31.79	79.75	38.43	60.66	91.56	62.18	67.4	75.76	66.99	55.41
all-mpnet-base-v2	65.27	67.13	31.92	81.86	39.72	70.72	92.08	70.21	69.57	76.01	60.86	55.46
allenai-specter	58.7	57.77	26.26	66.66	24.82	56.35	74.53	50.05	51.73	58.58	57.44	45.52
bert-base-uncased	74.25	71.33	33.56	63.41	35.28	65.35	82.63	68.14	59.88	64.28	70	51.81
contriever-base-msmarco	72.19	68.63	37.42	80.02	44.77	67.04	93.18	69.31	67.78	76	67.77	56.1
glove.6B.300d	56.91	60.32	29.67	67.69	36.93	62.57	79.11	55.85	56.19	66.03	65.4	50.8
gtr-t5-base	69.33	67.82	38.48	79.26	42.2	65.99	92.42	62.44	67.05	75.4	66.6	56.02
gtr-t5-large	70.03	73.92	37.21	81.21	46.33	70.86	94.01	63.86	70.06	75.49	68.65	54.09
gtr-t5-xl	68.6	74.58	38.2	82.22	45.54	68.15	93.6	65.93	70.23	75.94	67.56	54.77
gtr-t5-xxl	67.3	75.05	37.3	82.32	43.19	70.8	93.84	67.71	70.61	77.77	68.48	54.54
komninos	60.54	59.59	31.01	67.05	33.18	63.98	78.57	57.07	57.21	66.11	67.76	49.68
msmarco-bert-co-condensor	64.06	66.88	34.85	82.35	41.91	60.17	91.34	71.07	70.4	73.73	64.01	55.74
paraphrase-multilingual-MiniLM-L12-v2	71.57	69.21	35.11	79.77	42.37	60.46	87.06	65.52	66.84	71.51	66.07	56.12
paraphrase-multilingual-mpnet-base-v2	75.81	76.41	38.51	81.07	45.83	64.57	89.24	68.69	69.32	75.35	71.02	59.03
sentence-t5-base	75.82	85.12	44.94	76.48	51.35	77.34	90.34	63.32	69.74	72.32	68.2	62.71
sentence-t5-large	75.51	92.87	47.12	78.46	51.74	87.01	90.99	64.98	71.78	73.16	71.73	62.33
sentence-t5-xl	76.01	93.17	48.18	80.88	51.95	87.54	90.73	68.15	72.09	73.26	70.95	61.21
sentence-t5-xxl	77.07	92.79	48.93	82.31	48.57	90.23	92.49	68.33	73.44	74.82	70.04	62.01
sup-simcse-bert-base-uncased	75.75	82.47	39.6	75.76	44.81	73.53	84.29	63.14	65.95	70.78	72.04	59.73
text-embedding-ada-002	75.94	86.72	44.78	80.66	48.74	77.98	92.13	64.68	70.15	75.33	72.29	61.81
text-similarity-ada-001	76.4	92.83	47.45	68.04	50.33	89.38	89.89	64.8	65.17	67.67	70	63.35
unsup-simcse-bert-base-uncased	67.09	74.48	33.85	73.55	42.22	69.63	81.71	59.23	59.84	66.25	68.82	53.36
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	65.21	73.21	34.96	82.06	46.39	64.05	92.08	71.19	68.65	76.04	68.73	55.67
SGPT-125M-weightedmean-msmarco-specb-bitfit	61.24	65.4	31.17	77.7	39.08	58.67	86.96	62.25	61.41	69.74	62.66	52.41
SGPT-125M-weightedmean-nli-bitfit	65.88	74.94	35.1	74.68	42.23	62.9	81.52	58.24	58.08	66.34	62.79	54.82
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	67.57	71.44	35.75	83.22	49.21	63.53	92.56	71.85	69.01	75.9	68.84	56.69
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	69.22	71.26	39.19	84.49	49.66	66.64	93.47	72.42	70.39	76.28	67.71	56.85
SGPT-5.8B-weightedmean-nli-bitfit	74.07	82.31	41.58	81.74	49.92	74.33	89.64	70.68	70	75.03	69.93	62.44
sgpt-bloom-7b1-msmarco	68.06	68.97	33.86	84.33	44.87	61.77	93.68	71.34	69.67	75.34	66.55	55.85
e5-small	76.22	87.53	42.61	81.87	46.86	75.55	92.05	73.24	72.22	75.78	72.76	63.31
instructor-large	88.13	91.53	47.86	78.51	52.73	88.32	93.89	67.98	68.9	73.35	71.05	64.13
instructor-base	86.21	88.36	44.64	77.04	51.76	81.17	93.72	70.26	67.48	72.59	71.82	63.31
instructor-xl	85.09	86.54	42.96	82.66	53.24	79.79	95.07	72.26	71.48	76.47	70.33	61.58
e5-base	79.72	87.96	42.65	83.33	49.44	75.96	93.21	74.77	72.25	76.76	74.12	61.38
e5-large	77.69	90.05	43.02	84.14	48.05	82.11	93.86	76.4	73.22	77.39	70.56	61.21
random_embedding	72.76	55.74		60.23	20.12	53.83	70.81	58.95	48.85	48.12	55.47	41.45
all-mpnet-base-v2-negation	72.63	85.12	37.79	84.7	45.63	74.73	93.06	78.19	73.87	77.54	67.67	58.44
all-mpnet-base-v2	65.03	67.13	31.44	81.68	42.21	71.17	91.88	68.25	69.79	75.68	66.09	55.03
universal-sentence-encoder-multilingual-large-3	70.81	67.05	35.85	74.67	42.31	63.69	92.48	70.27	69.05	75.8	68.22	59.19
universal-sentence-encoder-multilingual-3	69.84	65.24	33.95	72.79	35.6	66.32	90.4	62.28	66.12	73.74	67.56	57.24
universal-sentence-encoder-4	70.67	67.73	32.62	74.12	38.64	68.43	90.12	65	67.23	72.79	68.99	57.01
universal-sentence-encoder-large-5	76.19	69.63	35.53	78.13	45.48	64.06	92.94	74.43	71.69	77.2	70.17	59.31
paraphrase-multilingual-mpnet-base-v2-KE_Sieve	79.06	70.19	34.29	75.89	40.26	61.14	87.22	69.45	65.6	70.37	70.26	54.49
e5-small-v2	77.6	91.27	45.88	81.64	47.06	86	92.7	72.56	71.62	76.36	71.1	61.46
e5-base-v2	77.78	92.81	46.71	83.53	46.95	86.15	93.69	75.31	73.04	77.65	72.11	60.39
e5-large-v2	79.22	93.75	48.61	84.55	49.45	91.69	94.62	77.14	73.84	78.11	70.9	60.94
multilingual-e5-base	78.97	90.64	44.55	82.74	45.18	85.46	93.13	75.27	72.11	77.08	69.78	61.28
LLaMA-embeeding	84.82	76.88	36.72		41.93		87.95	78.43	65.91	67.62		56.28
openai_clip_embeddings	57.49		30.59	73.42	33.62	56.17	87.07	61.96	62.96	71.47		49.34
text2vec-base-multilingual	70.97	66.1	33.13	78.08	43.35	59.35	81.05	62.79	63.83	66.96	65.97	55.22
cai-stellaris-text-embeddings	64.87	65.17	31.02	74.12	36.71	66.9	89.13	62.62	61.95	70.2	63.57	51.04
multilingual-e5-small	73.79	88.7	44.7	79.42	42.45	80.82	91.07	71.08	70.3	74.48	69.39	62.62
multilingual-e5-large	79.06	93.49	47.56	84.73	46.5	90.23	93.67	77.9	73.76	77.51	71.32	61.98
jina-embedding-s-en-v1	64.58	61.93	28.5	74.49	34.39	58.27	89.86	59.04	65	72.15	59.69	53.54
jina-embedding-b-en-v1	66.58	65.1	30.63	84.11	41.33	65.75	91.72	74.95	71.43	77.05	65.53	56.47

Classification Multilingual Leaderboard 💜💚💙

Metric: Accuracy
Languages: 51

Model	AmazonCounterfactualClassification (de)	AmazonCounterfactualClassification (en)	AmazonCounterfactualClassification (en-ext)	AmazonCounterfactualClassification (ja)	AmazonPolarityClassification	AmazonReviewsClassification (de)	AmazonReviewsClassification (en)	AmazonReviewsClassification (es)	AmazonReviewsClassification (fr)	AmazonReviewsClassification (ja)	AmazonReviewsClassification (zh)	Banking77Classification	EmotionClassification	ImdbClassification	MTOPDomainClassification (de)	MTOPDomainClassification (en)	MTOPDomainClassification (es)	MTOPDomainClassification (fr)	MTOPDomainClassification (hi)	MTOPDomainClassification (th)	MTOPIntentClassification (de)	MTOPIntentClassification (en)	MTOPIntentClassification (es)	MTOPIntentClassification (fr)	MTOPIntentClassification (hi)	MTOPIntentClassification (th)	MassiveIntentClassification (af)	MassiveIntentClassification (am)	MassiveIntentClassification (ar)	MassiveIntentClassification (az)	MassiveIntentClassification (bn)	MassiveIntentClassification (cy)	MassiveIntentClassification (da)	MassiveIntentClassification (de)	MassiveIntentClassification (el)	MassiveIntentClassification (en)	MassiveIntentClassification (es)	MassiveIntentClassification (fa)	MassiveIntentClassification (fi)	MassiveIntentClassification (fr)	MassiveIntentClassification (he)	MassiveIntentClassification (hi)	MassiveIntentClassification (hu)	MassiveIntentClassification (hy)	MassiveIntentClassification (id)	MassiveIntentClassification (is)	MassiveIntentClassification (it)	MassiveIntentClassification (ja)	MassiveIntentClassification (jv)	MassiveIntentClassification (ka)	MassiveIntentClassification (km)	MassiveIntentClassification (kn)	MassiveIntentClassification (ko)	MassiveIntentClassification (lv)	MassiveIntentClassification (ml)	MassiveIntentClassification (mn)	MassiveIntentClassification (ms)	MassiveIntentClassification (my)	MassiveIntentClassification (nb)	MassiveIntentClassification (nl)	MassiveIntentClassification (pl)	MassiveIntentClassification (pt)	MassiveIntentClassification (ro)	MassiveIntentClassification (ru)	MassiveIntentClassification (sl)	MassiveIntentClassification (sq)	MassiveIntentClassification (sv)	MassiveIntentClassification (sw)	MassiveIntentClassification (ta)	MassiveIntentClassification (te)	MassiveIntentClassification (th)	MassiveIntentClassification (tl)	MassiveIntentClassification (tr)	MassiveIntentClassification (ur)	MassiveIntentClassification (vi)	MassiveIntentClassification (zh-CN)	MassiveIntentClassification (zh-TW)	MassiveScenarioClassification (af)	MassiveScenarioClassification (am)	MassiveScenarioClassification (ar)	MassiveScenarioClassification (az)	MassiveScenarioClassification (bn)	MassiveScenarioClassification (cy)	MassiveScenarioClassification (da)	MassiveScenarioClassification (de)	MassiveScenarioClassification (el)	MassiveScenarioClassification (en)	MassiveScenarioClassification (es)	MassiveScenarioClassification (fa)	MassiveScenarioClassification (fi)	MassiveScenarioClassification (fr)	MassiveScenarioClassification (he)	MassiveScenarioClassification (hi)	MassiveScenarioClassification (hu)	MassiveScenarioClassification (hy)	MassiveScenarioClassification (id)	MassiveScenarioClassification (is)	MassiveScenarioClassification (it)	MassiveScenarioClassification (ja)	MassiveScenarioClassification (jv)	MassiveScenarioClassification (ka)	MassiveScenarioClassification (km)	MassiveScenarioClassification (kn)	MassiveScenarioClassification (ko)	MassiveScenarioClassification (lv)	MassiveScenarioClassification (ml)	MassiveScenarioClassification (mn)	MassiveScenarioClassification (ms)	MassiveScenarioClassification (my)	MassiveScenarioClassification (nb)	MassiveScenarioClassification (nl)	MassiveScenarioClassification (pl)	MassiveScenarioClassification (pt)	MassiveScenarioClassification (ro)	MassiveScenarioClassification (ru)	MassiveScenarioClassification (sl)	MassiveScenarioClassification (sq)	MassiveScenarioClassification (sv)	MassiveScenarioClassification (sw)	MassiveScenarioClassification (ta)	MassiveScenarioClassification (te)	MassiveScenarioClassification (th)	MassiveScenarioClassification (tl)	MassiveScenarioClassification (tr)	MassiveScenarioClassification (ur)	MassiveScenarioClassification (vi)	MassiveScenarioClassification (zh-CN)	MassiveScenarioClassification (zh-TW)	ToxicConversationsClassification	TweetSentimentExtractionClassification
LASER2	67.82	76.84	76.17	68.76	61.01	31.07	28.71	32.72	31.12	28.94	30.89	57.76	24.83	57.58	74.08	75.36	73.47	72.26	72.95	72.68	51.62	49.47	52.75	50.12	45.55	50.07	38.01	12.7	37.16	19.98	42.51	17.33	45.61	44.79	46.71	47.91	45.44	45.01	45.94	46.13	42.55	40.2	42.77	28.07	45.81	39.86	48.25	45.3	24.3	22.7	22.48	4.32	44.26	39.75	41.33	16.2	43.23	25.37	37.74	45	44.99	48.55	44.3	44.29	44.72	46.12	45.95	31.89	29.63	36.03	43.39	29.73	43.93	26.11	44.33	40.62	32.93	47.1	17.7	45.21	28.21	50.52	22.58	54.87	54.34	55.47	55.92	52.77	52.5	52.63	54.32	52.41	47.37	53.43	33.57	54.38	49.78	54.84	54.12	32.71	26.92	27.23	10.06	52.01	44.82	49.1	21.51	53.6	29.72	43.9	53.33	52.92	53.41	50.48	51.84	51.29	55.65	54.64	42.04	36.72	42.08	52.15	37.34	52.56	32.6	50.97	50.22	42.32	54.05	48.73
LaBSE	73.17	75.93	76.09	76.42	68.95	39.92	35.8	39.39	38.52	36.44	36.45	69.85	37.22	62.04	86.95	86.06	84.07	84.14	85.11	81.24	63.42	63.03	64.44	62.01	62.58	64.61	56.12	55.71	50.86	58.97	58.22	50.16	58.25	56.21	57.03	61.46	58.32	62.33	60.12	60.47	56.55	59.4	59.52	56.2	61.12	54.9	59.83	63.11	50.98	48.35	48.55	56.24	60.99	57.1	57.91	58.5	58.6	57.35	57.91	59.37	59.71	60.16	57.92	60.67	59.37	58.03	59.66	51.62	55.04	58.32	56.58	55.28	60.91	56.7	56.67	63.86	59.51	63.39	62.02	57.72	63.48	61.84	56.13	65.24	62.39	64.58	66.41	63.61	67.46	64.58	65.1	63.53	64.4	65.82	61.25	65.84	61.94	64.09	67.72	58.29	53.38	56.18	61.74	67.26	61.87	62.26	62.6	65.63	62.94	64.29	65.16	64.56	63.28	62.41	65.25	64.25	64.54	66.01	58.36	59.08	64.13	64.34	60.23	65.43	61.52	61.05	70.85	67.08	66.9	58.82
all-MiniLM-L12-v2	57.1	65.28	67.24	59.91	62.98	25.91	30.79	27.63	27.54	23.57	22.99	80.4	41.17	59.76	72.04	91.9	72.99	75.59	40.36	17.1	43.41	62.84	41.88	38.94	17.75	5.63	38.94	2.45	20.94	34.25	13.67	35.71	44.43	44.17	28.7	67.15	40.91	23.52	39.27	44.82	23.65	17.98	38	8.69	39.66	35.14	43.17	30.94	36.69	9.17	4.99	3.08	19.97	38.61	2.85	23.25	36.21	4.38	41.91	41.85	37.63	45.12	41.71	26.33	38.52	41.62	40.42	35.28	13.1	2.56	10.54	38.56	35.9	16.18	37.38	23.74	22.39	45.71	7.41	27.62	39.58	18.98	41.4	49.47	52.07	35.51	74.58	50.74	29	45.8	53.76	25.68	23.02	44.09	14.83	44.35	43.08	51.71	36.75	44.57	14.84	9.75	8.32	25.72	42.75	7.25	29.03	44.65	10.07	47.36	49.15	44.72	53	49.97	28.75	42.26	49.14	46.83	43.18	19.38	7.74	18.32	48.31	41.79	24.46	40.94	33.18	31.16	67.47	54.25
all-MiniLM-L6-v2		64.15			62.58		31.79					79.75	38.43	60.66		91.56						62.18														67.4																																																			75.76																																										66.99	55.41
all-mpnet-base-v2		65.27			67.13		31.92					81.86	39.72	70.72		92.08						70.21														69.57																																																			76.01																																										60.86	55.46
allenai-specter	54.46	58.7	59.28	43.87	57.77	24.08	26.26	23.88	23.31	20.25	20.49	66.66	24.82	56.35	48.55	74.53	58.39	54.61	21.22	14.98	35.55	50.05	36.72	34.71	4.44	4.67	33.68	2.94	10.04	30.74	3.02	33.94	38.47	36.06	27.7	51.73	35.6	17.97	35.53	38.41	2.69	3.43	34.05	3.11	40.02	32.63	39.28	4.95	34.95	2.57	4.73	3.54	2.68	37.91	2.88	16.94	36.6	3.96	34.75	33.95	35.77	43.05	36.2	25.3	35.9	36.6	36	34.81	3.11	2.53	4.38	35.51	32.02	9.61	37.07	2.81	4.79	36.17	7.64	15.26	30.73	7.15	34.73	39.93	38.62	27.18	58.58	39.44	21.43	33.21	40.26	7.42	8.06	34.54	8.61	40.04	33.57	40.1	9.96	36.11	7.13	9.66	7.55	7.27	37.03	7.22	21.53	37.57	9.54	35.71	34.62	36.87	44.68	37.29	28.16	37.95	37.82	35.35	35.37	7.19	7.29	9.47	37.31	34.57	16.17	35.91	9.19	10.19	57.44	45.52
bert-base-uncased		74.25			71.33		33.56					63.41	35.28	65.35		82.63						68.14														59.88																																																			64.28																																										70	51.81
contriever-base-msmarco		72.19			68.63		37.42					80.02	44.77	67.04		93.18						69.31														67.78																																																			76																																										67.77	56.1
glove.6B.300d		56.91			60.32		29.67					67.69	36.93	62.57		79.11						55.85														56.19																																																			66.03																																										65.4	50.8
gtr-t5-base		69.33			67.82		38.48					79.26	42.2	65.99		92.42						62.44														67.05																																																			75.4																																										66.6	56.02
gtr-t5-large	59.38	70.03	69.86	45.87	73.92	33.06	37.21	34	33.48	21.78	21.83	81.21	46.33	70.86	81.91	94.01	84.7	82.48	22.11	16.36	52.13	63.86	52.62	46.39	3.9	5.38	41.02	2.34	4.87	34.92	2.52	35.87	45.3	51.48	10	70.06	53.3	3.59	37.35	54.83	2.52	2.88	33.52	3.13	40.11	34.77	51.21	4.75	35.6	2.71	5.48	2.44	2.59	38.15	2.67	18.47	35.58	4.35	43.78	45.96	39.08	52.27	46.39	16.82	37.3	41.73	43.51	35.97	1.52	2.57	3.94	41.03	33.75	2.57	25.23	2.41	4.64	51.48	7.74	12.03	41.77	8.07	43.67	54.88	63.63	16.83	75.49	61.48	6.48	43.54	64.06	8.03	7.5	42.59	9.22	48.67	43.87	59.83	5.62	42.18	7.52	9.55	8.34	6.11	43.35	7.28	23.94	45.18	9.33	52.71	57.02	46.79	59.45	56.8	25.85	42.51	50.41	54.16	43.02	7.21	6.9	8.7	51.76	42.54	9.32	31.51	3.84	8.16	68.65	54.09
gtr-t5-xl	59.79	68.6	69.03	50.59	74.58	35.06	38.2	37.18	35.48	22.24	21.89	82.22	45.54	68.15	85.42	93.6	88.2	85.05	21.74	15.87	55.75	65.93	57.73	51.07	3.19	5.55	42.6	2.12	4.64	35.05	2.84	36.19	48.42	55.49	10.14	70.23	56.72	3.54	37.13	57.67	2.56	3.24	34.22	3.01	46.54	34.77	54.13	4.27	36.97	2.72	5.35	3.17	2.64	36.32	3.18	22.85	42.87	4.04	45.87	49.53	42.64	57.03	49.95	36.58	39.44	41.78	47.95	35.85	2.32	2.2	3.74	43.12	35.24	3	30.01	1.72	3.35	52.54	6.3	11.96	40.17	8.29	42.24	57.28	68.09	16.66	75.94	64.32	6.9	43.96	66.72	7.51	7.82	42.16	9.33	53.54	42.84	62.44	7.29	43.13	7.63	9.08	8.1	6.35	40.24	7.65	27.98	52.41	9.21	54.44	60.35	49.97	62.78	59.62	43.44	44.79	50.84	58.21	44.63	7.95	7.5	8.79	53.54	42.47	9.58	34.68	5.21	8.77	67.56	54.77
gtr-t5-xxl		67.3			75.05		37.3					82.32	43.19	70.8		93.84						67.71														70.61																																																			77.77																																										68.48	54.54
komninos		60.54			59.59		31.01					67.05	33.18	63.98		78.57						57.07														57.21																																																			66.11																																										67.76	49.68
msmarco-bert-co-condensor		64.06			66.88		34.85					82.35	41.91	60.17		91.34						71.07														70.4																																																			73.73																																										64.01	55.74
paraphrase-multilingual-MiniLM-L12-v2	68.35	71.57	69.99	63.45	69.21	35.91	35.11	37.49	35.3	33.24	35.26	79.77	42.37	60.46	79.2	87.06	83.04	78.63	81.36	79.99	54.23	65.52	60.28	54.05	59.9	61.96	45.88	36.75	45.14	47.42	35.34	26.12	57.73	50.71	58.7	66.84	59.66	61.02	57.54	60.25	52.51	58.37	60.41	51.6	59.85	30.83	59.61	60.89	32.37	43.03	40.04	40.98	50.3	54.68	42.41	51.77	54.76	52.01	55.5	59.51	59.43	61.27	58.39	59.04	57.36	56.59	59.43	29.57	36.77	40.72	58.97	33.67	59.9	52.8	56.61	61.99	58.77	53.64	41.89	51.74	52.06	41.17	31.72	66.87	57.4	66.14	71.51	65.04	65.86	63.75	66.06	59.2	65.21	66.56	56.11	66.16	37.52	65	66.5	38.6	50.66	46.96	45.73	55.66	59.8	47.69	57.07	61.71	59.1	64.25	65.52	65.04	65.79	64.17	65.24	64.01	64.31	67.14	34.86	42.62	46.46	67.01	37.37	66.55	60.43	60.72	67.44	65.7	66.07	56.12
paraphrase-multilingual-mpnet-base-v2	69.95	75.81	76.23	69.79	76.41	39.52	38.51	39.99	39	36.64	37.74	81.07	45.83	64.57	85.73	89.24	86.96	81.21	84.76	82.51	61.27	68.69	66.59	59.76	62.37	64.8	52.32	41.55	51.43	56.98	48.79	27.87	62.77	59.57	62.62	69.32	64.43	65.34	62.28	64.82	58.21	62.77	63.87	57.74	65.43	37.05	64.68	63.74	36.49	49.85	45.47	50.63	61.82	61.29	54.34	56.59	60.7	57.09	62.6	63.57	64.3	64.89	62.8	63.26	63.51	62.49	64.73	31.95	50.17	52.82	61.11	38.83	64.54	56.37	59.68	65.33	62.35	59.67	48.97	57.78	61.53	54.53	35.26	71	67.34	68.81	75.35	70.42	69.88	67.6	70.69	65.16	67.92	70.3	63.02	70.73	44.16	69.73	69.69	44.2	57.3	53.14	56.08	68.52	66.28	60.13	60.85	65.81	63.03	70.24	70.37	68.99	70.09	67.95	69.92	70.81	69.63	71.6	37.29	55.96	58.81	69.44	43.99	70.4	62.9	65.71	71.23	68.73	71.02	59.03
sentence-t5-base	69.98	75.82	76.81	46.05	85.12	37.9	44.94	37.33	37.35	22.29	21.53	76.48	51.35	77.34	76.98	90.34	73.61	75.03	21.4	16.21	44.43	63.32	42.03	43.85	3.8	5.21	34.32	2.38	4.53	31.76	2.58	28.94	38.82	45.23	10.05	69.74	45.32	3.58	33.52	51.13	2.63	2.68	32.31	3.33	35.5	29.82	45.59	3.67	31.15	2.77	5.66	2.59	2.34	33.97	2.55	14.7	33.12	4.42	38.53	37.96	34.41	43.35	42.69	14.82	34.54	38.54	35.98	32.14	1.41	2.5	3.71	36.04	33.77	2.99	22.62	1.12	4.63	44.45	7.51	12.32	38.41	8.45	35.04	48.36	59.12	17.68	72.32	55.61	6.86	41.34	59.92	7.86	7.63	41.31	9.23	44.64	39.63	54.58	4.96	40.73	7.51	8.73	7.99	6.03	36.42	6.96	19.85	43.18	9.46	46.6	50	42.3	52.24	53.7	20.69	39.79	50.16	46.69	40.48	7.47	6.87	8.26	48.94	41.83	9.77	30.01	4.17	7.91	68.2	62.71
sentence-t5-large	67.97	75.51	75.44	45.72	92.87	43.16	47.12	42.89	41.48	22.49	22.12	78.46	51.74	87.01	80.56	90.99	80.78	79.6	21.22	15.82	52.5	64.98	52.07	47.73	3.74	4.96	38.41	2.49	4.7	31.77	2.77	31.69	41.76	52.01	9.74	71.78	54.1	3.86	34.07	57.01	2.14	2.97	32.01	3.17	34.55	32	52.94	2.9	32.42	2.71	5.5	2.41	2.57	35.09	2.95	18.33	29.69	3.99	41.29	44.95	37.67	51.96	43.83	17.32	33.71	37.62	40.67	31.9	1.91	2.54	3.85	36.83	33	2.62	22.81	1.09	3.49	50.28	7.15	12.12	39.68	8.06	38.01	51.44	62.71	17.19	73.16	59.56	6.5	41.72	63.6	7.93	7.85	41.37	9.42	44.88	40.86	60.09	6.56	40.18	7.37	9.56	8.4	5.96	41.44	7.47	25.36	39.69	9.68	49.92	56.09	45.2	57.99	56	27.47	41.04	49.38	50.97	40.62	7.59	7.07	8.52	49.89	43.08	9.31	27.46	4.7	7.24	71.73	62.33
sentence-t5-xl	67.01	76.01	77.29	45.61	93.17	44.05	48.18	45.01	43.52	22.23	21.88	80.88	51.95	87.54	83.28	90.73	85.32	85.14	20.85	15.62	54.65	68.15	57.38	54.39	3.28	5.08	40.17	2.18	4.18	30.02	2.6	29.15	47.69	57.43	9.96	72.09	57.97	3.6	34.02	60.99	2.51	3.02	31.66	3.32	41.53	30.25	56.57	3.5	31.67	2.79	5.43	2.79	2.67	34.25	2.98	20.99	37.43	4.02	45.91	50.51	43.95	57.95	49.37	33.46	36.33	37.65	46.35	30.6	1.79	2.26	4.02	38.92	32.05	2.7	21.47	0.59	3.24	50.81	6.95	12.32	38.79	8	33.91	55.79	65.33	16.89	73.26	62.52	6.08	43.34	66.42	7.55	7.44	40.85	9.25	51.92	40.09	62.94	7.9	41.33	7.76	9.19	8.36	6.13	40.7	6.98	27	46.9	9.55	53.43	59.65	49.87	62.18	58.22	40.73	43.66	49.25	57.17	40.55	7.46	7.03	8.52	51.74	43.01	9.61	28.91	5.86	7.14	70.95	61.21
sentence-t5-xxl		77.07			92.79		48.93					82.31	48.57	90.23		92.49						68.33														73.44																																																			74.82																																										70.04	62.01
sup-simcse-bert-base-uncased		75.75			82.47		39.6					75.76	44.81	73.53		84.29						63.14														65.95																																																			70.78																																										72.04	59.73
text-embedding-ada-002		75.94			86.72		44.78					80.66	48.74	77.98		92.13						64.68														70.15																																																			75.33																																										72.29	61.81
text-similarity-ada-001		76.4			92.83		47.45					68.04	50.33	89.38		89.89						64.8														65.17																																																			67.67																																										70	63.35
unsup-simcse-bert-base-uncased		67.09			74.48		33.85					73.55	42.22	69.63		81.71						59.23														59.84																																																			66.25																																										68.82	53.36
SGPT-1.3B-weightedmean-msmarco-specb-bitfit		65.21			73.21		34.96					82.06	46.39	64.05		92.08						71.19														68.65																																																			76.04																																										68.73	55.67
SGPT-125M-weightedmean-msmarco-specb-bitfit	56.88	61.24	58.28	54.65	65.4	24.79	31.17	26.64	26.39	22.08	24.27	77.7	39.08	58.67	62.73	86.96	67.55	65.35	45.37	55.28	49.56	62.25	49.94	46.33	32.21	43.63	40.55	24.18	30.13	35.88	29.17	41.79	44.18	42.07	36.25	61.41	42.68	35.59	40.04	43.44	31.59	27.04	38.45	27.98	43.97	40.3	45.47	45.61	38.67	25.65	28.3	23.48	36.56	41.85	24.91	29.86	42.42	25.13	39.82	43.62	42.2	45.21	41.81	35.97	40.61	42.76	42.35	41.12	24.6	25.04	35.4	41.19	36.41	25.93	38.8	46.24	42.31	43.25	25.3	32.07	36.68	29.57	42.1	45.44	43.21	36.5	69.74	44.08	32.61	40.36	45.07	32.18	26.9	40.38	28.38	44.36	39.29	46.47	46.26	41.13	24.73	29.74	23.85	36.57	40.93	25.53	29.11	43.79	27.27	39.02	45.36	41.89	45.9	44.12	32.76	40.5	42.52	42.29	43	28.33	26.59	36.79	42.57	37.09	28.84	37.36	49.38	44.42	62.66	52.41
SGPT-125M-weightedmean-nli-bitfit	59.08	65.88	64.92	56.42	74.94	24.52	35.1	29.1	27.4	21.72	23.98	74.68	42.23	62.9	60.37	81.52	67.37	63.13	47.05	52.28	45.07	58.24	48.81	44.34	34.2	43.11	37.79	23.72	29.64	39.48	26.55	38.78	43.56	40.39	37.29	58.08	41.18	36.42	38.76	43.67	31.98	28.04	38.14	26.05	41.16	38.63	44.04	46.21	37.61	24.47	26.24	17.83	37.27	40.93	17.89	32.98	40.91	17.83	39.48	41.76	42.62	44.54	39.97	37.46	38.29	40.95	41.85	38.33	19.03	19.38	34.09	40.29	38.86	27.83	38.71	45.78	42.32	40.25	25.69	32.4	40.53	27.23	38.7	44.75	41.36	38.44	66.34	44.18	34.83	40.56	45.92	32.08	28.37	39.49	25.9	40.96	38.56	46.59	46.25	39.66	25.28	28.97	19.27	35.73	39.57	19.9	32.43	42.32	20.86	40.47	43.59	41.88	46.31	42.53	35.95	38.69	40.47	41.52	39.55	22.88	20.51	34.93	40.75	39.07	29.75	38.02	48.55	45.18	62.79	54.82
SGPT-2.7B-weightedmean-msmarco-specb-bitfit		67.57			71.44		35.75					83.22	49.21	63.53		92.56						71.85														69.01																																																			75.9																																										68.84	56.69
SGPT-5.8B-weightedmean-msmarco-specb-bitfit		69.22			71.26		39.19					84.49	49.66	66.64		93.47						72.42														70.39																																																			76.28																																										67.71	56.85
SGPT-5.8B-weightedmean-nli-bitfit	66.64	74.07	77.22	58.06	82.31	35.29	41.58	38.34	37.84	30.94	33.75	81.74	49.92	74.33	84.54	89.64	86.46	81.32	58.23	72.29	60.52	70.68	64.32	58.67	41.96	55.28										70																																																			75.03																																										69.93	62.44
sgpt-bloom-1b7-nli									39.29		37.63							83.8						63.36																64.58																																																			69.6
sgpt-bloom-7b1-msmarco	61.35	68.06	67.78	58.23	68.97	29.7	33.86	35.97	35.92	27.64	32.63	84.33	44.87	61.77	82.05	93.68	93.55	90.98	89.33	60.49	61.92	71.34	74.49	69.12	64.85	49.36	47.85	33.3	59.25	45.24	61.59	44.92	51.23	56.1	46.13	69.67	66.35	51.2	45.33	66.95	43.18	63.54	44.73	38.13	64.06	44.35	60.77	61.22	50.94	33.84	37.34	53.54	53.36	46.5	58.27	40.28	59.65	37.42	49.41	52.09	50.48	66.69	50.53	58.32	47.74	48.94	50.79	49.81	56.4	54.71	44.43	50.21	46.56	56.75	64.53	67.07	62.89	51.47	34.87	65.21	45.58	67.3	46.29	53.52	61.74	48.96	75.34	73.34	53.17	44.69	72.91	43.1	69.27	45.16	38.73	70.13	44.21	65.57	65.76	54.79	32.99	39.34	60.5	55.69	44.35	65.53	38.72	64.99	36.84	51.8	56.32	49.98	71.46	53.69	61.6	48.04	50.06	51.73	54.22	62.77	62.59	45.18	52.06	47.21	64.26	70.61	73.95	70.3	66.55	55.85
e5-small		76.22			87.53		42.61					81.87	46.86	75.55		92.05						73.24														72.22																																																			75.78																																										72.76	63.31
instructor-large		88.13			91.53		47.86					78.51	52.73	88.32		93.89						67.98														68.9																																																			73.35																																										71.05	64.13
instructor-base		86.21			88.36		44.64					77.04	51.76	81.17		93.72						70.26														67.48																																																			72.59																																										71.82	63.31
instructor-xl		85.09			86.54		42.96					82.66	53.24	79.79		95.07						72.26														71.48																																																			76.47																																										70.33	61.58
e5-base		79.72			87.96		42.65					83.33	49.44	75.96		93.21						74.77														72.25																																																			76.76																																										74.12	61.38
e5-large		77.69			90.05		43.02					84.14	48.05	82.11		93.86						76.4														73.22																																																			77.39																																										70.56	61.21
random_embedding	70.35	72.76	73.61	65.55	55.74							60.23	20.12	53.83	70.47	70.81	73.55	66.56	40.99	15.73	59.24	58.95	57.41	50.54	28.97	4.78	47.38	2.61	26.24	46.69	28.74	45.28	47.85	46.33	30.1	48.85	47.64	35	48.93	44.56	25.77	23.21	45.8	16.85	48.28	45.6	49.62	37.51	44.92	17.7	4.4	3.95	28.49	49.23	2.81	31.64	48.66	3.8	46.17	47.35	46.46	48.66	46.83	30.74	47.53	47.7	47.97	48.14	17.38	2.83	16.15	46.44	46.5	28.24	46.77	25.11	24.23	49.09	7.19	27.68	45.12	29.82	47.32	46.12	47.04	29.35	48.12	47.71	36.23	47.91	44.44	26.28	25.24	46.54	20.01	48.21	46.39	48.47	39.92	47.35	22.32	8.4	7.6	31.63	48.27	7.85	32.12	50.02	9.85	45.68	46.79	44.33	45.17	45.79	29.66	48.74	45.94	48.28	50.56	22.2	6.61	26.25	44.27	45.14	30.3	45.6	32.37	30.09	55.47	41.45
all-mpnet-base-v2-negation		72.63			85.12		37.79					84.7	45.63	74.73		93.06						78.19														73.87																																																			77.54																																										67.67	58.44
all-mpnet-base-v2		65.03			67.13		31.44					81.68	42.21	71.17		91.88						68.25														69.79																																																			75.68																																										66.09	55.03
universal-sentence-encoder-multilingual-large-3		70.81			67.05		35.85					74.67	42.31	63.69		92.48						70.27														69.05																																																			75.8																																										68.22	59.19
universal-sentence-encoder-multilingual-3		69.84			65.24		33.95					72.79	35.6	66.32		90.4						62.28														66.12																																																			73.74																																										67.56	57.24
universal-sentence-encoder-4		70.67			67.73		32.62					74.12	38.64	68.43		90.12						65														67.23																																																			72.79																																										68.99	57.01
universal-sentence-encoder-large-5		76.19			69.63		35.53					78.13	45.48	64.06		92.94						74.43														71.69																																																			77.2																																										70.17	59.31
paraphrase-multilingual-mpnet-base-v2-KE_Sieve		79.06			70.19		34.29					75.89	40.26	61.14		87.22						69.45														65.6																																																			70.37																																										70.26	54.49
e5-small-v2		77.6			91.27		45.88					81.64	47.06	86		92.7						72.56														71.62																																																			76.36																																										71.1	61.46
e5-base-v2		77.78			92.81		46.71					83.53	46.95	86.15		93.69						75.31														73.04																																																			77.65																																										72.11	60.39
e5-large-v2		79.22			93.75		48.61					84.55	49.45	91.69		94.62						77.14														73.84																																																			78.11																																										70.9	60.94
multilingual-e5-base	71.72	78.97	79.66	73.33	90.64	41.83	44.55	40.53	39.68	37.44	37.23	82.74	45.18	85.46	89.63	93.13	90.59	86.21	87.32	86.24	71.23	75.27	71.27	67.68	69.24	71.71	59.98	53.66	57.46	62.59	61.13	50.06	66.64	66.09	64.68	72.11	68.4	67.25	65.78	67.95	62.05	64.95	64.97	60.08	66.64	56.39	68.93	68.94	54.26	48.99	44.69	59.19	66.34	60.34	63.09	58.76	62.48	58.56	66.18	67.3	68.37	68.98	65.54	69.02	62.35	61.23	68.54	56	58.71	59.72	65.6	60.86	67.41	61.52	66.17	69.16	64.65	65.09	58.52	62.24	63.75	65	52.84	72.42	71.95	70.18	77.08	71.5	70.25	69.13	71.89	67.44	69.16	70.75	63.14	70.7	60.94	72.32	74.65	59.69	54.37	48.31	62.15	72.45	62.81	68.04	61.44	66.9	61.64	71.63	72.11	70.6	70.83	69.19	72.99	65.26	66.49	73.14	59.89	62.38	62.59	71.61	62.74	71.67	64.64	70.01	75.42	70.69	69.78	61.28
LLaMA-embeeding		84.82			76.88		36.72						41.93			87.95						78.43														65.91																																																			67.62																																											56.28
openai_clip_embeddings		57.49					30.59					73.42	33.62	56.17		87.07						61.96														62.96																																																			71.47																																											49.34
text2vec-base-multilingual	68.69	70.97	70.91	61.61	66.1	33.39	33.13	34.82	33.45	30.05	32.52	78.08	43.35	59.35	78.59	81.05	79.24	76.17	78.75	77.67	55.29	62.79	58.68	53.26	59.62	58.8	45.42	37.68	45.02	48.71	43.79	28.76	56.74	51.56	56.47	63.83	58.28	59.05	57.36	58.8	51.18	57.06	58.36	52.11	58.27	35.81	58.28	60.78	31.15	44.5	40.99	46.96	54.73	54.87	47.89	52.23	54.28	51.96	54.64	59.45	58.91	59.84	57.04	58.02	56.36	56.48	58.44	33.96	44.29	47.14	56.86	35.36	59.63	52.79	54.65	60.86	57.47	50.86	41.18	50.08	51.29	46.53	34.35	63.07	56.4	61.8	66.96	62.21	62.44	61.1	63.39	56.29	60.63	63.29	54.88	61.99	38.58	62.35	65.17	36.13	50.27	44.24	47.37	58.89	56.51	50.06	55.05	59.77	55.72	60.26	63.38	62.55	62.41	60.68	62.31	61.43	62.23	64.43	38.52	47	51.02	63.23	38.72	64.49	56.8	57.06	65.83	63.37	65.97	55.22
cai-stellaris-text-embeddings		64.87			65.17		31.02					74.12	36.71	66.9		89.13						62.62														61.95																																																			70.2																																										63.57	51.04
multilingual-e5-small	71.65	73.79	75.81	64.19	88.7	40.25	44.7	40.39	38.86	37.68	37.5	79.42	42.45	80.82	87.47	91.07	89.27	84.23	86.02	85.35	65.86	71.08	67.97	61.32	66.3	67.52	57.07	51.96	54.43	59.8	59.38	46.56	62.97	62.73	61.6	70.3	66.31	65.54	61.46	65.47	58.05	64.07	60.95	57.4	64.17	52.26	65.54	68.23	50.85	48.45	42.83	57.51	63.79	54.99	61.9	57.1	58.99	55.9	61.96	65.64	64.53	66.85	60.81	65.76	56.52	57.99	65.03	53.57	57.26	57.83	64.07	58.91	63.54	59.28	64.07	68.24	62.54	63.04	56.84	59.62	60.85	62.77	50.18	68.93	69.19	67.07	74.48	69.83	68.71	65.95	68.76	63.81	67.69	66.47	59.5	67.92	56.49	69.04	73.89	56.63	52.24	46.62	59.16	69.85	56.66	66.54	59.31	64.88	58.86	67.37	70.87	68.22	68.18	64.65	69.48	60.18	62.86	70.89	58.15	59.44	60.85	70.66	60.88	68.05	62.11	67.44	74.47	68.32	69.39	62.62
multilingual-e5-large	71.22	79.06	80.42	77.84	93.49	45.4	47.56	43.07	41.89	40.12	38.83	84.73	46.5	90.23	91.95	93.67	92.2	89	89.78	88.75	74.53	77.9	75.44	70.56	73.12	74.29	62.38	56.07	60.75	64.87	63.97	54.98	69.46	69.33	69.09	73.76	70.49	69.91	70.12	69.34	67.61	67.8	69.69	62.07	70.05	62.42	70.53	72.51	57.91	51.78	47.02	62.16	69.43	67.08	65.57	61.71	66.04	60.88	69.88	70.45	71.55	70.73	68.36	71.7	67.09	65.18	71.76	58.5	62.69	63.02	68.29	64.77	69.87	64.05	69.38	71.12	66.2	68.74	60.59	66.23	66.48	67.75	59.09	75.06	74.7	73.9	77.51	74.31	72.95	73.12	73.87	71.4	72.13	74.52	64.94	74.12	67.15	74.32	77.47	63.32	58.35	50.88	66.44	75.05	70.5	69.94	64.79	69.88	63.25	74.84	74.83	74.13	73.49	71.72	75.14	71.87	70.28	76.1	63.14	66.28	66.69	73.45	67.71	73.99	68.15	73.11	76.83	71.81	71.32	61.98
jina-embedding-s-en-v1		64.58			61.93		28.5					74.49	34.39	58.27		89.86						59.04														65																																																			72.15																																										59.69	53.54
jina-embedding-b-en-v1		66.58			65.1		30.63					84.11	41.33	65.75		91.72						74.95														71.43																																																			77.05																																										65.53	56.47

Model	ArxivClusteringP2P	ArxivClusteringS2S	BiorxivClusteringP2P	BiorxivClusteringS2S	MedrxivClusteringP2P	MedrxivClusteringS2S	RedditClustering	RedditClusteringP2P	StackExchangeClustering	StackExchangeClusteringP2P	TwentyNewsgroupsClustering
LASER2	17.77	12.39	12.4	8.83	17.91	16.63	9.96	26.42	15.79	18.63	11.38
LaBSE	32.13	22.05	29.84	20.57	30.13	24.82	28.79	49.14	35.43	28.83	23.28
all-MiniLM-L12-v2	46.07	37.5	36.99	33.21	34.25	32.24	51.18	54.8	53.05	33.13	47.47
all-MiniLM-L6-v2	46.55	37.86	38.48	33.17	34.41	32.29	50.67	54.15	53.36	38	46.86
all-mpnet-base-v2	48.38	39.72	39.62	35.02	35.58	32.87	54.82	56.77	53.8	34.28	49.74
allenai-specter	44.75	35.27	39.52	34.53	35.04	31.66	24.13	35.06	39.01	31.46	24.22
bert-base-uncased	35.19	27.51	30.12	24.77	26.09	23.6	27.24	43.32	43.58	26.55	23.35
contriever-base-msmarco	42.61	32.32	34.97	29.08	31.19	27.27	54.89	57.58	63.15	32.25	46.82
glove.6B.300d	32.56	23.14	29.27	19.18	26.12	20.38	28.46	35.82	35.8	28.51	25.83
gtr-t5-base	35.49	27.18	27.66	23.25	27.57	25.13	56.13	58.53	64.21	33.01	46.72
gtr-t5-large	37.5	30.55	29.59	25.72	28.72	27.39	61.69	61.67	69.93	33.21	51.64
gtr-t5-xl	37.9	30.45	30.52	26.06	28.69	26.69	61.34	61.11	69.95	32.73	51.15
gtr-t5-xxl	37.9	32.39	30.48	27.5	29.12	27.56	64.13	62.84	71.43	32.85	50.44
komninos	34.73	26.01	29.76	20.71	26.65	21.5	28.84	7.37	39.04	30.23	27.42
msmarco-bert-co-condensor	36.94	29.03	32.35	28.16	30.23	27.01	48.04	53.53	59.54	30.48	38.68
paraphrase-multilingual-MiniLM-L12-v2	38.33	31.55	33.49	29.44	31.52	30.87	42.02	50.73	49.6	31.69	39.28
paraphrase-multilingual-mpnet-base-v2	37.78	31.68	33.09	29.6	31.96	31.7	45.24	51.31	52.98	32.94	44.1
sentence-t5-base	39.28	27.26	33.99	22.92	33.2	26.13	52.93	59.67	63.13	35.68	48.1
sentence-t5-large	41.62	29.44	35.99	24.02	32.4	26.33	54.53	62.5	65.11	36.86	49.33
sentence-t5-xl	41.62	31.17	36.43	26.47	32.3	26.93	57.03	62.34	67.13	34.79	49.53
sentence-t5-xxl	42.89	33.47	36.53	28.66	32.09	26.82	58.99	64.46	70.78	35.25	50.93
sup-simcse-bert-base-uncased	35.18	27.54	30.15	24.67	26.25	24.12	40.23	47.74	47.55	29.45	34.86
text-embedding-ada-002	45.01	36.85	36.66	34.21	32.6	30.8	61.42	64.13	72.22	38.49	52.56
text-similarity-ada-001	41.49	28.47	36.86	27.55	31.09	26.5	42.47	58.1	53.52	30.43	36.26
text-similarity-babbage-001							45.64		53.01		42.01
text-similarity-curie-001							40.79		55.14		37.64
text-similarity-davinci-001							31.78		36.86		29.33
text-search-ada-doc-001											32.92
text-search-ada-001				26.05		25.67					44.92
unsup-simcse-bert-base-uncased	32.61	24.68	24.9	19.55	23.6	21.97	32.18	45.14	43.07	28.5	23.21
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	43.38	33.71	35.06	30.71	32.08	29.45	48.23	53.18	60.86	32.36	40.06
SGPT-125M-weightedmean-msmarco-specb-bitfit	39.71	28.24	33.63	27.04	31.37	26.87	40.23	49.09	52.74	32.66	32.13
SGPT-125M-weightedmean-nli-bitfit	34.74	24.68	28.93	23.08	28.3	24.93	33.76	41.01	44.59	28.23	28.24
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	44.72	35.08	34.41	30.53	31.35	28.77	46.47	54.17	59.19	32.57	40.89
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	45.59	38.86	36.55	33.7	31.51	28.76	40.45	55.75	59.21	33.95	39.46
SGPT-5.8B-weightedmean-nli-bitfit	40.55	32.49	33.59	29.13	30.33	28.02	42.17	48.02	54.13	31.12	37.2
sgpt-bloom-7b1-msmarco	44.59	38.03	36.03	32.48	31.05	29.26	35.53	54.52	55.13	34.31	37.28
e5-small	44.14	37.14	35.81	31.86	31.34	28.2	42.87	56.39	59.08	30.3	37.51
instructor-large	43.16	32.56	37.62	31.33	34.22	32	63.65	64.63	68.78	36.15	54.13
instructor-base	39.68	29.19	32.98	25.72	30.89	28.38	59.26	63.22	65.04	35.28	51.31
instructor-xl	42.45	32.21	37.37	30.55	33.19	30.79	63.49	65.13	68.44	35.17	53.38
e5-base	44.57	40.48	36.19	32.72	31.53	28.29	48.18	62.19	63.91	32.56	42.58
e5-large	46.19	41.38	37.6	35.09	32.26	29.66	50.69	61.37	64.96	33.6	43.81
all-mpnet-base-v2-negation	45.73	39.14	37.61	34.5	33.67	31.95	47.14	51.6	49.34	31.52	44.23
all-mpnet-base-v2	48.32	39.45	39.35	35.3	35.68	33.3	55.1	56.77	53.75	34.26	50.5
universal-sentence-encoder-multilingual-large-3	34.75	22.62	28.75	20.14	31.2	25.8	46.17	56.53	49.34	33.4	36.93
universal-sentence-encoder-multilingual-3	33.72	23.99	30.88	21.05	28.68	24.25	43.82	58.37	47.83	33.01	37.47
universal-sentence-encoder-4	35.13	23.46	31.17	18.81	28.88	23.31	49.72	57.92	54.64	31.58	38.23
universal-sentence-encoder-large-5	34.72	25.27	28.39	20.52	30.27	24.58	56.93	58.95	60.85	33.14	42.43
e5-small-v2	42.12	34.8	35.89	30.05	31.34	27.88	45.72	59.66	58.51	31.98	41.13
e5-base-v2	46.1	39.67	37.5	32.72	31.46	28.99	56.16	63.43	65.15	32.5	48.16
e5-large-v2	45.55	41.02	37.36	34.85	31.82	30.38	55.83	63.38	65.92	33.67	49.6
multilingual-e5-base	40.28	35.42	35.04	29.46	28.92	28.43	42.41	55.17	55.27	30.46	35.97
LLaMA-embeeding		30.15		24.29		23.01	21.29		35.55		18.35
openai_clip_embeddings			29.33	27.81
text2vec-base-multilingual	32.32	25.5	28.99	23.2	29.44	26.16	31.25	43.3	34.36	30.64	31.58
cai-stellaris-text-embeddings	42.01	31.41	34.73	29.28	31.77	30.94	43.09	56.54	48.23	34.76	34.36
multilingual-e5-small	39.22	30.8	35.75	27.05	30.9	27.26	39.13	58.98	53.52	32.07	33.22
multilingual-e5-large	44.31	38.43	35.34	33.5	31.48	29.71	46.54	63.22	57.53	32.69	38.91
jina-embedding-s-en-v1	34.98	24.37	29.66	22.32	28.26	23.87	35.85	47.27	47.81	29.83	32.41
jina-embedding-b-en-v1	39.22	29.88	32.99	26.49	30.01	25.57	43.1	51.71	52.08	31.61	39.27

Model	BlurbsClusteringP2P	BlurbsClusteringS2S	TenKGnadClusteringP2P	TenKGnadClusteringS2S
cross-en-de-roberta-sentence-transformer	30.82	12.69	23.5	10.94
gbert-base	35.36	11.27	37.16	24.23
gbert-large	39.3	13.38	41.69	34.97
gelectra-base	10.06	7.74	9.02	4.11
gelectra-large	13.96	7.57	11.49	3.91
gottbert-base	34.49	8.37	33.66	9.34
komninos	11.37	8.01	15.89	4.84
paraphrase-multilingual-MiniLM-L12-v2	32.46	14.33	36.13	22.26
paraphrase-multilingual-mpnet-base-v2	34.38	15.81	35.96	22
sentence-t5-base	30.59	11.57	44.88	18.11
sentence-t5-large	35.33	13.27	44.11	17.26
sentence-t5-xxl	39.91	15.94	43.43	19.69
use-cmlm-multilingual	29.63	15.24	37.1	25.64
xlm-roberta-large	29.84	7.29	32.46	6.16
SGPT-125M-weightedmean-nli-bitfit		8

Model	SprintDuplicateQuestions	TwitterSemEval2015	TwitterURLCorpus
LASER2	65.54	59.57	81.47
LaBSE	89.26	62.78	84.58
all-MiniLM-L12-v2	92.45	70.02	84.77
all-MiniLM-L6-v2	94.55	67.86	84.7
all-mpnet-base-v2	90.15	73.85	85.11
allenai-specter	71.63	43.25	69.22
bert-base-uncased	36.81	55.9	76.29
contriever-base-msmarco	95.55	66.85	85.21
glove.6B.300d	86.96	48.45	77.35
gtr-t5-base	94.55	72.23	84.77
gtr-t5-large	95.05	76.03	84.89
gtr-t5-xl	95.45	77.81	85.14
gtr-t5-xxl	95.68	77.54	85.13
komninos	85.55	53.85	79.41
msmarco-bert-co-condensor	96.09	65.95	83.17
paraphrase-multilingual-MiniLM-L12-v2	89.46	62.06	83.83
paraphrase-multilingual-mpnet-base-v2	90.55	66.75	85.14
sentence-t5-base	91.23	78.25	86.05
sentence-t5-large	89.01	79.75	86.14
sentence-t5-xl	91.44	80.89	85.86
sentence-t5-xxl	88.89	80.28	86.01
sup-simcse-bert-base-uncased	69.39	67.75	83.89
text-embedding-ada-002	92.17	75.28	87.22
text-similarity-ada-001	77.85	69.04	83.69
text-similarity-babbage-001	76.46	70.85	85.08
text-similarity-curie-001	79.85	69.45	84.06
text-similarity-davinci-001	69.52	74.42	83.75
unsup-simcse-bert-base-uncased	69.41	60.21	81.37
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	92.58	62.37	83.79
SGPT-125M-weightedmean-msmarco-specb-bitfit	89.89	54.75	81.06
SGPT-125M-weightedmean-nli-bitfit	77.73	57.09	80.51
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	93.47	63.68	84.8
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	93.84	66.87	85.29
SGPT-5.8B-weightedmean-nli-bitfit	80.54	66	84.54
sgpt-bloom-7b1-msmarco	94.93	65.31	85.46
e5-small	95.29	74.16	85.79
instructor-large	93.07	77.42	87.18
instructor-base	90.35	73.99	86.2
instructor-xl	94.94	77.99	86.93
e5-base	94.88	74.4	85.98
e5-large	95.42	76.1	86.31
all-mpnet-base-v2-negation	84.82	76.85	84.77
all-mpnet-base-v2	90.15	73.85	85.11
universal-sentence-encoder-multilingual-large-3	90.89	63.76	84.2
universal-sentence-encoder-multilingual-3	87.05	57.03	82.21
universal-sentence-encoder-4	86.37	60.64	81.68
universal-sentence-encoder-large-5	84.37	70.13	84.09
paraphrase-multilingual-mpnet-base-v2-KE_Sieve	77.36	63.58	82.64
e5-small-v2	94.88	73.34	85.79
e5-base-v2	94.58	75.97	86.63
e5-large-v2	94.92	76.92	86.25
multilingual-e5-base	93.01	72.21	85.48
LLaMA-embeeding	57.56
text2vec-base-multilingual	83.53	62.49	83.46
cai-stellaris-text-embeddings	93.23	69.6	83.49
multilingual-e5-small	92.18	70.75	84.83
multilingual-e5-large	93.13	75.28	85.83
jina-embedding-s-en-v1	90.94	61.49	82.85
jina-embedding-b-en-v1	91.08	68.63	84.82

Model	AskUbuntuDupQuestions	MindSmallReranking	SciDocsRR	StackOverflowDupQuestions
LASER2	48.99	24.79	54.99	36.98
LaBSE	52.75	29.81	68.72	42.42
all-MiniLM-L12-v2	64.06	31.02	87.2	51.47
all-MiniLM-L6-v2	63.48	30.8	87.12	50.76
all-mpnet-base-v2	65.85	30.97	88.65	51.98
allenai-specter	50.07	24.8	81.31	36.22
bert-base-uncased	45.84	28.37	64.94	34.62
contriever-base-msmarco	56.69	31.58	76.51	47.78
glove.6B.300d	49.57	27.01	62.56	34.03
gtr-t5-base	60.86	31.33	73.71	51.01
gtr-t5-large	61.64	31.84	76.39	51.58
gtr-t5-xl	63.08	31.5	76.49	52.79
gtr-t5-xxl	63.23	31.93	77.96	53.5
komninos	50.88	28.92	63.55	35.65
msmarco-bert-co-condensor	58.99	27.13	72.78	48.48
paraphrase-multilingual-MiniLM-L12-v2	60.49	30.37	77.78	45.85
paraphrase-multilingual-mpnet-base-v2	60.16	30.15	78.09	46.79
sentence-t5-base	59.73	30.2	73.96	48.46
sentence-t5-large	61.51	30.27	74.88	49.34
sentence-t5-xl	62.86	29.77	75.16	51.05
sentence-t5-xxl	66.16	30.6	76.09	52.85
sup-simcse-bert-base-uncased	51.8	29.3	70.14	38.9
text-embedding-ada-002	62.05	31.45	81.22	50.54
text-similarity-ada-001	53.49	30.71	71.04	40.85
text-similarity-babbage-001	54.68		72.78	40.65
text-similarity-curie-001	55.09		70.93	42.42
text-similarity-davinci-001	53.56		68.7	39.41
unsup-simcse-bert-base-uncased	51.57	28.62	66.33	39.35
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	58.13	31.34	77.21	49.32
SGPT-125M-weightedmean-msmarco-specb-bitfit	55.84	30.4	71.34	44.74
SGPT-125M-weightedmean-nli-bitfit	52.63	29.27	68.36	39.97
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	59.63	31.72	77.72	49.61
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	61.63	32.29	80.79	51.53
SGPT-5.8B-weightedmean-nli-bitfit	55.9	31.11	77.54	44.77
sgpt-bloom-7b1-msmarco	59.97	31.79	79.77	51.07
e5-small	59.36	29.56	79.76	49.13
instructor-large	64.3	31.68	82	52.17
instructor-base	63.17	31.82	78.83	50.99
instructor-xl	65.35	31.81	79.49	52.52
e5-base	59.66	30.07	82.9	50.15
e5-large	60.07	30.78	83.94	51.33
all-mpnet-base-v2-negation	65.57	29.34	88.39	52.22
all-mpnet-base-v2	65.85	30.97	88.65	51.98
e5-small-v2	58.11	30.1	79.16	49.93
e5-base-v2	58.98	31.29	83.02	50.34
e5-large-v2	59.62	31.83	84.31	50.68
multilingual-e5-base	58.23	30.97	80.74	49.41
LLaMA-embeeding	48.66		66.69	39.5
text2vec-base-multilingual	57.91		70.21	44.9
cai-lunaris-text-embeddings	53.44	28.54	68.65	40.76
cai-stellaris-text-embeddings	60.35	30.98	81.45	48.17
multilingual-e5-small	57.88	30.28	78.13	49.2
multilingual-e5-large	60.28	31.42	82.04	49.72
jina-embedding-s-en-v1	60.59	29.25	74.31	47.86
jina-embedding-b-en-v1	62.72	31.01	79.54	50.87

Model	BIOSSES	SICK-R	STS12	STS13	STS14	STS15	STS16	STS17 (en-en)	STS22 (en)	STSBenchmark
LASER2	62.01	62.86	62.6	59.62	57.03	71.57	70.75	76.73	39.76	69.77
LaBSE	78.7	69.99	65.08	67.98	64.03	76.59	72.98	79.45	60.97	72.25
all-MiniLM-L12-v2	83.57	79.32	73.08	82.13	76.73	85.58	80.23	88.63	65.67	83.09
all-MiniLM-L6-v2	81.64	77.58	72.37	80.6	75.59	85.39	78.99	87.59	67.21	82.03
all-mpnet-base-v2	80.43	80.59	72.63	83.48	78	85.66	80.03	90.6	67.95	83.42
allenai-specter	64.95	56.39	62.49	58.7	54.87	62.54	64.27	69.63	55.06	61.26
bert-base-uncased	54.7	58.65	30.87	59.89	47.73	60.29	63.73	64.1	56.37	47.29
contriever-base-msmarco	83.32	70.2	64.34	80.03	74.51	83.3	79.67	86.32	64.64	78.81
glove.6B.300d	44.93	55.43	54.64	69.16	60.81	72.31	65.34	77.95	56.35	61.54
gtr-t5-base	79	71.45	68.59	79.09	74.64	84.85	81.57	85.8	66.17	79.58
gtr-t5-large	84.86	73.39	70.33	82.19	77.16	86.31	81.85	83.93	64.3	77.6
gtr-t5-xl	78.94	73.63	69.11	81.82	77.07	86.01	82.23	84.9	66.61	77.65
gtr-t5-xxl	81.91	74.29	70.12	82.72	78.24	86.26	81.61	85.18	65.76	77.73
komninos	50.25	55.49	53.51	70.8	63.56	74.08	64.6	76.91	53.89	61.55
msmarco-bert-co-condensor	77.32	72	68.19	80.4	74.02	82.57	79.78	85.94	67.54	76.97
paraphrase-multilingual-MiniLM-L12-v2	74.18	79.61	76.02	80.7	78.85	85.84	81.05	86.87	61.72	84.42
paraphrase-multilingual-mpnet-base-v2	76.27	79.62	77.9	85.11	80.81	87.48	83.2	86.99	63.06	86.82
sentence-t5-base	75.89	80.18	78.05	85.85	82.19	87.46	84.03	89.57	62.66	85.52
sentence-t5-large	78.93	80.34	79.11	87.33	83.17	88.28	84.36	88.99	62.39	85.36
sentence-t5-xl	73.12	79.98	79.02	88.8	84.33	88.89	85.31	88.91	64.32	83.93
sentence-t5-xxl	80.43	80.47	78.85	88.94	84.86	89.32	84.67	89.46	65.33	84.01
sup-simcse-bert-base-uncased	68.38	80.77	75.3	84.67	80.19	85.4	80.82	89.44	61.96	84.25
text-embedding-ada-002	86.35	80.6	69.8	83.27	76.09	86.12	85.96	90.25	68.12	83.17
text-similarity-ada-001	78.04	77.48	72.3	81.49	74.74	84.28	82.06	87.08	64.71	83.78
text-similarity-babbage-001	78.12	77.02								84.32
text-similarity-curie-001	77.46	77.26								83.02
text-similarity-davinci-001	68.95	78.72								84.08
unsup-simcse-bert-base-uncased	72.31	72.24	66.05	81.49	73.61	79.72	78.12	83.58	59.65	76.52
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	83.02	67.23	66.59	77.33	71.83	80.66	78.91	86.99	67.3	77.59
SGPT-125M-weightedmean-msmarco-specb-bitfit	75.21	65.93	66.53	76.17	69.05	79.24	76.07	84.95	65.66	75.34
SGPT-125M-weightedmean-nli-bitfit	70.93	74.57	69.17	77.23	70.99	79.74	77.93	87.33	59.64	79.54
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	84.84	68.2	66.99	77.58	72.78	82.62	80.1	87.25	68.75	79.21
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	86.25	69.63	67.5	79.16	74.46	84.47	80.96	87.78	69.35	81.39
SGPT-5.8B-weightedmean-nli-bitfit	79.5	79.59	74.29	85.35	79.21	85.52	82.54	90.44	63.2	85.67
sgpt-bloom-7b1-msmarco	85.31	69.82	69.66	79.67	74.61	83.81	80.4	87.07	66.13	80.9
e5-small	84.22	78.9	75.19	81.8	78.48	87.49	84.58	87.94	63.76	86.36
instructor-large	84.39	81.27	76.28	88.18	81.92	89.01	85.49	90.3	67.74	86.88
instructor-base	82.31	80.26	77.02	86.58	81.32	88.19	84.88	89.46	66.45	86.43
instructor-xl	84.15	81.7	75.32	87.44	81.87	88.94	85.38	90.54	68.65	86.56
e5-base	85.1	79.66	74.22	83.31	78.52	88.35	84.15	87.23	62.88	86.18
e5-large	84.73	80.49	75.93	85.22	80.54	88.81	85.28	89.37	62.99	87.21
all-mpnet-base-v2-negation	71.13	77.46	72.98	85.52	79.87	85.35	81.96	90.16	60.92	84.65
all-mpnet-base-v2	80.43	80.59	72.63	83.48	78	85.66	80.03	90.6	67.95	83.42
universal-sentence-encoder-multilingual-large-3	79.14	76.43	74.25	71.82	71.38	82.47	77.54	86.38	52.85	81.24
universal-sentence-encoder-multilingual-3	78.19	74.43	72.58	72.22	69.98	82.22	76.91	85.22	61.9	80.28
universal-sentence-encoder-4	63.38	69.79	67.06	71.54	70.59	80.27	75.76	84.94	60	77.08
universal-sentence-encoder-large-5	69.36	76.84	72.49	73.65	71.88	82.9	79.83	85.19	48.44	79.93
paraphrase-multilingual-mpnet-base-v2-KE_Sieve	65.29	76.01	71.25	78.4	74.23	81.41	79.13	85.4	58.63	81.34
e5-small-v2	79.43	78.51	76.21	82.4	79	87.76	83.8	87.72	63.15	85.95
e5-base-v2	81.4	78.3	75.79	83.58	79.95	88.82	84.46	87.58	64.07	86.52
e5-large-v2	83.6	79.28	76.95	84.12	80.46	89.76	85.47	89.03	64.11	87.74
multilingual-e5-base	85.06	78.51	76.7	78.03	76.6	88.16	84.28	87.83	61.83	85.64
LLaMA-embeeding	67.85	57.32	42.8	58.77	53.36	69.23	58.81	68.6		52.67
text2vec-base-multilingual	66.16	79.97	80.91	82.86	87.36	88.31	81.61	85.81	62.99	86.45
cai-lunaris-text-embeddings	73.97	68.99	58.5	74.03	66.18	75.55	73.71	80.14	65.65	71.4
multilingual-e5-small	82.26	77.51	76.56	76.97	75.52	87.12	83.63	86.44	60.94	84.01
multilingual-e5-large	82.51	80.23	80.02	81.55	77.72	89.31	85.78	88.12	63.06	87.29
jina-embedding-s-en-v1	80.46	72.44	73.64	78.04	74.54	83.89	79.04	86.77	64.28	78.84
jina-embedding-b-en-v1	82.64	75.04	73.51	79.15	75.24	85.12	80.07	87.96	66.08	81.69

Model	SummEval
LASER2	26.8
LaBSE	31.05
all-MiniLM-L12-v2	27.9
all-MiniLM-L6-v2	30.81
all-mpnet-base-v2	27.49
allenai-specter	27.66
bert-base-uncased	29.82
contriever-base-msmarco	30.36
glove.6B.300d	28.87
gtr-t5-base	29.67
gtr-t5-large	29.5
gtr-t5-xl	30.21
gtr-t5-xxl	30.64
komninos	30.49
msmarco-bert-co-condensor	29.5
paraphrase-multilingual-MiniLM-L12-v2	30.67
paraphrase-multilingual-mpnet-base-v2	31.57
sentence-t5-base	31.39
sentence-t5-large	29.64
sentence-t5-xl	29.91
sentence-t5-xxl	30.08
sup-simcse-bert-base-uncased	31.17
text-embedding-ada-002	30.8
text-similarity-ada-001	26.94
unsup-simcse-bert-base-uncased	31.15
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	30.43
SGPT-125M-weightedmean-msmarco-specb-bitfit	29.71
SGPT-125M-weightedmean-nli-bitfit	30.26
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	31.03
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	31.46
SGPT-5.8B-weightedmean-nli-bitfit	30.38
sgpt-bloom-7b1-msmarco	33.6
e5-small	31.39
instructor-large	31.84
instructor-base	29.85
instructor-xl	32.32
e5-base	31.01
e5-large	30.97
all-mpnet-base-v2-negation	30.15
all-mpnet-base-v2	27.49
universal-sentence-encoder-multilingual-large-3	29.71
universal-sentence-encoder-multilingual-3	30.79
universal-sentence-encoder-4	29.42
universal-sentence-encoder-large-5	29.01
e5-small-v2	31.16
e5-base-v2	30.28
e5-large-v2	30.19
multilingual-e5-base	30.11
LLaMA-embeeding	30.62
text2vec-base-multilingual	30.1
cai-lunaris-text-embeddings	29.02
multilingual-e5-small	29.98
multilingual-e5-large	29.69
jina-embedding-s-en-v1	28.96
jina-embedding-b-en-v1	30.08

Made with ❤️ for NLP. If this work is useful to you, please consider citing:

@article{muennighoff2022mteb,
    doi = {10.48550/ARXIV.2210.07316},
    url = {https://arxiv.org/abs/2210.07316},
    author = {Muennighoff, Niklas and Tazi, Nouamane and Magne, Lo{\"\i}c and Reimers, Nils},
    title = {MTEB: Massive Text Embedding Benchmark},
    publisher = {arXiv},
    journal={arXiv preprint arXiv:2210.07316},  
    year = {2022}
}

Model	BUCC (de-en)	BUCC (fr-en)	BUCC (ru-en)	BUCC (zh-en)	Tatoeba (afr-eng)	Tatoeba (amh-eng)	Tatoeba (ang-eng)	Tatoeba (ara-eng)	Tatoeba (arq-eng)	Tatoeba (arz-eng)	Tatoeba (ast-eng)	Tatoeba (awa-eng)	Tatoeba (aze-eng)	Tatoeba (bel-eng)	Tatoeba (ben-eng)	Tatoeba (ber-eng)	Tatoeba (bos-eng)	Tatoeba (bre-eng)	Tatoeba (bul-eng)	Tatoeba (cat-eng)	Tatoeba (cbk-eng)	Tatoeba (ceb-eng)	Tatoeba (ces-eng)	Tatoeba (cha-eng)	Tatoeba (cmn-eng)	Tatoeba (cor-eng)	Tatoeba (csb-eng)	Tatoeba (cym-eng)	Tatoeba (dan-eng)	Tatoeba (deu-eng)	Tatoeba (dsb-eng)	Tatoeba (dtp-eng)	Tatoeba (ell-eng)	Tatoeba (epo-eng)	Tatoeba (est-eng)	Tatoeba (eus-eng)	Tatoeba (fao-eng)	Tatoeba (fin-eng)	Tatoeba (fra-eng)	Tatoeba (fry-eng)	Tatoeba (gla-eng)	Tatoeba (gle-eng)	Tatoeba (glg-eng)	Tatoeba (gsw-eng)	Tatoeba (heb-eng)	Tatoeba (hin-eng)	Tatoeba (hrv-eng)	Tatoeba (hsb-eng)	Tatoeba (hun-eng)	Tatoeba (hye-eng)	Tatoeba (ido-eng)	Tatoeba (ile-eng)	Tatoeba (ina-eng)	Tatoeba (ind-eng)	Tatoeba (isl-eng)	Tatoeba (ita-eng)	Tatoeba (jav-eng)	Tatoeba (jpn-eng)	Tatoeba (kab-eng)	Tatoeba (kat-eng)	Tatoeba (kaz-eng)	Tatoeba (khm-eng)	Tatoeba (kor-eng)	Tatoeba (kur-eng)	Tatoeba (kzj-eng)	Tatoeba (lat-eng)	Tatoeba (lfn-eng)	Tatoeba (lit-eng)	Tatoeba (lvs-eng)	Tatoeba (mal-eng)	Tatoeba (mar-eng)	Tatoeba (max-eng)	Tatoeba (mhr-eng)	Tatoeba (mkd-eng)	Tatoeba (mon-eng)	Tatoeba (nds-eng)	Tatoeba (nld-eng)	Tatoeba (nno-eng)	Tatoeba (nob-eng)	Tatoeba (nov-eng)	Tatoeba (oci-eng)	Tatoeba (orv-eng)	Tatoeba (pam-eng)	Tatoeba (pes-eng)	Tatoeba (pms-eng)	Tatoeba (pol-eng)	Tatoeba (por-eng)	Tatoeba (ron-eng)	Tatoeba (rus-eng)	Tatoeba (slk-eng)	Tatoeba (slv-eng)	Tatoeba (spa-eng)	Tatoeba (sqi-eng)	Tatoeba (srp-eng)	Tatoeba (swe-eng)	Tatoeba (swg-eng)	Tatoeba (swh-eng)	Tatoeba (tam-eng)	Tatoeba (tat-eng)	Tatoeba (tel-eng)	Tatoeba (tgl-eng)	Tatoeba (tha-eng)	Tatoeba (tuk-eng)	Tatoeba (tur-eng)	Tatoeba (tzl-eng)	Tatoeba (uig-eng)	Tatoeba (ukr-eng)	Tatoeba (urd-eng)	Tatoeba (uzb-eng)	Tatoeba (vie-eng)	Tatoeba (war-eng)	Tatoeba (wuu-eng)	Tatoeba (xho-eng)	Tatoeba (yid-eng)	Tatoeba (yue-eng)	Tatoeba (zsm-eng)
LASER2	99.21	98.39	97.62	97.7	92.59	80.82	25.22	90.14	26.63	66.16	76.35	33.74	82.41	79.54	89.43	77.63	95.86	31.2	93.57	95.8	77.17	9.93	95.52	14.86	85.62	4.45	27.03	5.85	95.22	99.07	42.34	7.39	96.2	96.61	96.43	93.32	57.04	96.98	94.28	42.07	1.52	4.2	96.14	27.52	0	95.32	96.72	45.75	95.2	88.72	80.86	87.88	93.93	92.98	94.32	94.32	9.95	93.78	65.88	81.16	53.3	74.19	87.97	19.09	4.46	64.81	63.39	96.2	95.33	98.16	92.93	36.96	6.86	93.63	3.42	77.13	95.35	72.75	95.77	60.02	58.13	23.24	3.24	93.13	36.23	97.32	94.54	96.52	92.58	95.82	95.4	97.33	97.22	93.64	95.31	33.1	55.66	87.32	34.74	96.72	63.19	96.38	16.35	98.03	36.56	56.49	93.52	84.23	23.2	96.73	8.25	75.09	4.68	2.49	87.75	95.41
LaBSE	99.35	98.72	97.78	99.16	96.18	91.47	59.28	88.8	42.69	76	90.68	71.7	94.93	95	88.55	8.4	94.92	15.07	94.58	95.38	79.44	64.42	96.68	31.77	95.1	10.11	52.57	92	95.71	99.2	64.81	10.85	95.35	98.2	96.55	95.01	87.4	96.37	94.86	89.31	85.66	93.8	96.82	46.5	91.53	96.87	96.95	67.11	96.55	94.09	89.42	85.58	95.37	93.66	94.75	92.72	79.77	95.38	4.31	95.02	87.49	78.37	90.95	83.59	11.33	80.07	67.54	96.47	95.88	98.45	92.65	63.26	15.74	93.6	95.91	79.42	96.07	94.48	98.4	74.38	65.81	38.93	10.73	94.7	64.57	97.22	94.14	96.92	93.75	96.5	96.03	98.4	96.76	94.43	95.63	59.36	84.5	89	85.92	97.86	96.02	96.14	75.27	98	58.88	92.4	93.97	93.22	84.23	97.2	60.29	90.18	91.55	88.79	89.58	95.62
glove.6B.300d	0.18	0.19	0.1	0
gtr-t5-xl	90.99	88.55	2.07	1.49	33.47	0.01	30.74	0.47	0.34	0.14	51.74	0.49	7.43	3.45	0.06	5.79	17.43	5.69	7.55	48.06	54.56	8.72	8.76	27.56	2.26	3.69	13.18	6.97	47.36	91.54	13.2	4.54	0.55	27.86	5.13	10.23	21.44	6.62	79.66	32.92	2.87	3.26	63.81	29.71	0.33	0.25	17.16	12.02	7.21	0.78	40.83	54.95	72.28	30.95	11.29	73.83	8.66	0.61	1.78	0.79	0.95	0.49	1.87	10.91	5.72	18.24	43.49	7.13	7.04	0.44	0.03	18.99	1.11	2.49	2.01	39.96	58.86	29.07	40.25	50.19	30.72	0.85	7.21	0.53	31.07	18.06	81.92	62.6	22.24	10.59	11.4	85.78	14.92	9.87	55.08	32.66	7.64	0.49	1.28	0.45	23.63	0.61	5.71	8.25	28.4	0.57	5.69	0	4.19	9.07	12.31	1.38	7.6	0.41	1.31	29.74
komninos	0.18	0.08	0.15	0.05	4.82	1.18	8.54	0.63	0.4	0.63	11.69	0	3.22	1.75	0.2	7	9.31	4.17	1.29	7.73	5.61	4.88	3.55	19.29	0.5	4.15	5.69	8.4	6.99	3.67	5.33	4.25	0.63	2.45	2.69	4.69	7.61	3.36	7	12.36	3.07	4.81	8.12	18.87	0.68	0.1	5.41	6.32	3.42	0.97	7.1	13.61	8.57	7.26	4.09	5.54	11.43	0.2	2.71	1.11	1.17	0.55	0.5	8.55	4.61	4.07	2.83	0.95	3.25	0.29	0.2	14.53	0.2	0.2	1.1	10.37	9.5	4.49	4.95	14.53	5.8	0.24	6.65	0.5	8.05	5.13	5.87	6.76	0.2	4.23	6.05	5.03	4.36	1.77	6.72	8.54	11.49	1.3	0.77	0.85	2.61	0.69	5.76	5.24	15.51	0.6	1.23	0.4	4.73	6.55	4.12	0.2	4.33	0.59	0.5	7.27
paraphrase-multilingual-MiniLM-L12-v2	97.11	94.99	95.06	95.63	58.22	36.21	10.24	87.93	18.6	51.26	62.17	33.43	62.1	67.73	36.48	4.43	93.27	5.56	92.65	94.42	55.37	8.05	95.12	15.98	94.93	3.42	21.56	13.25	94.8	97.02	33.43	5.69	95.43	41.73	97.33	23.18	27.51	93.1	91.72	31.13	3.61	11.62	94	25.74	86.88	97.62	95.98	36.1	91.58	93.28	40.25	57.71	79.13	92.74	24.07	93.05	17.04	90.41	1.16	95.44	34.89	32.11	92.52	46.94	6.24	19.47	47.02	93.16	97.87	32.2	92.38	45.25	6.89	91	95.04	32.16	94.58	76.34	97.73	47.99	38.57	15.1	5.41	92.59	30.7	94.28	92.13	95.3	91.87	95.15	96.92	95.42	98.17	92.24	94.42	26.31	14.48	24.64	10.25	36.4	13.09	96.72	15.16	95.08	25.46	24.39	92.82	94.57	17.14	95.12	7.25	76	4.52	14.38	71.45	95.31
paraphrase-multilingual-mpnet-base-v2	98.59	96.89	96.44	97.56	72.96	53.49	16.72	90.19	19.84	55.69	70.08	42.83	76.36	79.94	64.9	4.88	94.02	6.42	93.52	96.05	58.68	7.39	95.73	12.59	95.83	3.53	23.73	22.31	96.17	97.73	36.85	5.03	94.93	55.12	98.4	31.33	38.24	95.92	93.12	43.54	4.72	16.85	95.32	25.12	88.26	97.75	97	44.32	94.18	94.38	43.91	60.36	84.32	93.5	59.25	93.76	23.39	92.51	1.41	95.46	61.49	58.8	93.07	61.44	5.88	24.25	49.56	95.37	97.53	88.46	93.83	48.77	7.57	93.02	96.14	38.88	95.5	81.41	98.53	50.23	43.49	23.77	5.39	93.47	34.19	96.95	93.02	96.43	92.92	96.62	97.08	97	98.57	94.12	95.45	22.8	16.02	73.6	10.89	79.73	17.67	95.99	14.91	96.17	34.21	48.35	92.67	95.12	23.19	97.23	7.42	78.25	6.53	30.73	77.58	95.8
sentence-t5-large	87	88.91	0.44	0.95	23.7	0.65	30.98	0.48	0.68	0.22	55.3	1.03	5.83	1.66	0	5.62	12.23	5.84	1.35	48.56	46.97	9.79	6	24.21	2.26	4.03	9.53	9.17	34.63	89.31	9.68	4.66	0.77	26.88	5.19	9.46	21.59	5.66	79.71	28.29	2.34	3.55	56.25	24.25	0.57	0.12	10.29	9.52	6.22	0.81	41.11	54	75.47	13.02	8.98	67.23	8.54	0.99	1.85	1.37	0.67	0.56	1.73	9.23	5.38	21.3	40.48	5.38	6.83	0.45	0.01	16.44	0.33	0.4	2.48	34.66	42.72	24.08	34.17	55.01	29.15	0.2	6.99	0.9	30.8	12.81	73.45	54.86	2.43	8.35	9.3	78.87	11.74	5.83	35.41	28.18	7.53	0.36	1.01	1.1	12.4	1.58	4.95	6.45	37.82	0.67	1.88	0	4.79	7.03	9.68	1.28	10.64	0.57	0.88	14.67
sentence-t5-xl	95.04	94.96	8.33	1.3	41.84	0.03	37.87	0.61	0.74	0.42	65.41	1.46	8.79	5.76	0.01	5.92	16.12	6.12	9.06	57.4	57.68	12.56	9.47	27.13	1.82	3.87	14.41	6.69	54.87	93.72	14.74	5.84	0.6	30.8	5.39	11.9	28.08	6.81	85.29	38.68	2.96	3.74	70	30.49	0.87	0.1	17.43	14.69	7.28	0.77	46.65	59.43	82.71	37.26	11.21	79.77	7.81	0.91	2.23	1.48	1.77	0.38	1.96	12.11	6.13	27.84	45.89	5.94	8.11	0.59	0.03	21.7	0.68	5.92	2.39	45.04	64.75	36.74	54.77	57.12	34.39	2.04	8.34	0.87	38.06	28.35	83.61	65.27	30.42	13.19	13.49	89.18	14.66	13.24	60.67	34.76	8.07	0.36	1.46	0.67	25.22	1.58	4.99	7.72	38.49	0.87	9.12	0	5.48	8.45	13.75	1.44	9.15	0.28	0.98	35.71
SGPT-125M-weightedmean-nli-bitfit	1.09	0.02	0	0
SGPT-5.8B-weightedmean-nli-bitfit	75.15	0.42	0.01	0.32
sgpt-bloom-7b1-msmarco	54	97.06	45.3	97.96	16.62	0.03	28.76	85.37	27.75	70.66	71.13	35.01	6.32	8.03	75.98	4.92	13.65	4.67	20.09	88.31	64.63	6.64	9.55	23.26	91.45	2.83	10.03	6.97	23.52	70.1	8.78	3.41	5.34	26.2	4.76	53.38	12.61	3.41	91.44	24.62	2.09	3.26	79.86	21.03	1.69	85.23	12.79	9.68	5.07	0.5	43.91	59.59	73.67	88.04	6.29	65.04	15.02	71.36	1.69	0.42	3.32	0.37	22.39	8.26	5.17	28.76	44.85	4.49	6.55	83.3	45.53	36.14	1.56	10.47	2.85	23.92	29.74	16.28	21.07	52.23	40.17	5.79	5.85	12.13	31.94	14.09	92.62	27.23	59.84	9.98	10.14	94.48	10.38	11.69	19.53	16.89	16.74	72.76	3.59	64.62	10.7	2.22	5.48	6.15	27.82	1.27	22.06	70.1	4.71	94.2	10.38	79.58	5.51	0.16	77.03	79.95
multilingual-e5-base	99.13	97.59	97.2	98.3	86.91	74.93	29.07	82.59	26.74	66.79	75.31	68.39	84.71	86.7	81.05	23.58	88.86	5.44	88.63	84.09	60.54	45.46	88.88	16.95	93.35	4.38	24.56	65.22	91.4	97.07	34.33	5.13	89.96	92.07	70.51	56.16	64.72	86.15	92.76	50.88	43.08	58.36	82.79	43.53	74.14	93	92.5	40.35	84.32	85.91	74.39	72.43	86.11	90.26	76.9	90.61	61.25	90.3	21.98	77.83	75.56	47.26	83.37	52.96	6.2	39.58	52.85	75.53	76.66	96.72	86.62	52.39	5.52	73.76	78.37	53.86	93.2	82.56	95.9	66.83	35.79	16	6.92	87.08	44.61	94.82	92.74	91.27	91.78	86.4	81.93	96.97	90.06	89.08	91.33	42.33	66.81	85.12	66.92	88.49	83.78	94.4	19.66	92.67	34.44	63.08	88.29	86.2	62.63	94.68	47.18	78.65	73.24	63.2	80.66	92.45
multilingual-e5-small	97.86	92.66	93.5	88.79	85.67	76.13	42.23	72.55	22.43	55.14	71.67	74.27	80.14	84.68	77.76	16.92	83.24	8.24	83.81	79.75	57.77	42.01	78.83	27.83	88.89	6.02	23.99	65.32	84.39	96.58	31.64	7.68	84.08	90.5	55.31	54.47	58.87	68.56	89.93	51.03	39.42	59.59	81.93	36.45	67.92	93.25	86.87	37.02	71.84	82.29	70.86	71.73	85.6	87.81	62.16	87.56	50.66	83.7	17.83	76.84	73.03	47.99	74.16	39.67	8.27	39.95	52.73	61.52	60.67	94.78	86.79	49.95	6.08	59.26	78.22	53.26	90.3	69.48	87.8	68.56	42.84	15.13	6.97	84	42.15	85.91	89.25	83.67	87.96	79.96	72.85	91.1	88.56	80.33	84.97	44.3	66.74	81.39	63.38	85.78	79.26	89.36	18.41	86.78	36.2	59.33	81.62	84.71	58	87.78	40.86	69.05	62.84	66.83	69.69	90
multilingual-e5-large	99.38	98.11	97.52	99.2	90.26	80.69	40.18	85.47	41.56	74.73	81.76	72.27	87.61	91.2	83.02	38.89	92.86	11.1	92.93	91.03	69.15	55.31	94.89	27.21	95.28	6.28	36.98	76.21	95.08	99.07	48.44	7	93.88	96.01	85.03	77.82	72.62	95.44	93.42	63.43	59.01	71.48	93.34	51.65	86.52	94.48	96.15	58.7	94.01	90.92	83.63	79.15	93.61	92.9	91.96	93.29	75.46	95.28	36.54	84.09	79.44	60.02	90.65	66.83	7.91	53.3	63.02	88.48	89.83	97.7	88.58	63.42	6.79	85.5	87.53	69.52	96.63	91.4	97.2	71.56	54.91	39.8	9.28	92.14	59.87	96.6	93.63	94.87	92.32	93.13	89.65	97.1	94.7	93.1	95.3	56.83	71.61	88.23	73.65	91.34	92	95.38	33.15	96.27	53.16	72.08	93.32	89.21	72.35	97	62.26	86.23	80.87	76.33	88.71	94.53

Model	ArguAna	CQADupstackAndroidRetrieval	CQADupstackEnglishRetrieval	CQADupstackGamingRetrieval	CQADupstackGisRetrieval	CQADupstackMathematicaRetrieval	CQADupstackPhysicsRetrieval	CQADupstackProgrammersRetrieval	CQADupstackRetrieval	CQADupstackStatsRetrieval	CQADupstackTexRetrieval	CQADupstackUnixRetrieval	CQADupstackWebmastersRetrieval	CQADupstackWordpressRetrieval	ClimateFEVER	DBPedia	FEVER	FiQA2018	HotpotQA	MSMARCO	NFCorpus	NQ	QuoraRetrieval	SCIDOCS	SciFact	TRECCOVID	Touche2020
LASER2	12.86	0	7.52	10.13	3.4	2.33	6.84	5.05	4.12	5.18	3.57	5.33	0.07	0	0.36	1.53	0.77	1.73	5.5	1.09	2.44	0.64	71.14	0.78	4.04	10.97	1.06
LaBSE	34.18	29.83	14.35	29.62	17.15	12.05	19.76	19.15	18.75	14.61	12.65	21.34	21.02	13.48	3.83	15.57	12.18	7	18.75	7.6	16.54	8.42	77.03	5.63	38.2	16.34	4.88
all-MiniLM-L12-v2	47.13	54.12	49.85	56.86	41.41	31.86	46.81	41.33	42.53	37.82	31.66	43.86	41.38	33.46	21.57	33.35	55.9	37.27	44.59	39.03	32.25	46.47	87.75	21.82	62.64	50.82	17.22
all-MiniLM-L6-v2	50.17	53.83	47.78	56.92	41.31	29.29	46.98	38.97	41.32	35.38	30.52	41.31	40.47	33.15	20.27	32.33	51.93	36.87	46.51	36.54	31.59	43.87	87.56	21.64	64.51	47.25	16.9
all-mpnet-base-v2	46.52	56.49	52.29	60.03	44.27	34.21	50.97	44.17	44.96	38.15	33.35	45.41	44.24	35.94	21.97	32.09	50.86	49.96	39.29	39.75	33.29	50.45	87.46	23.76	65.57	51.33	19.93
allenai-specter	32.67	18.91	14.31	18.14	13.61	11.09	21.98	15.69	14.6	14.4	8.04	12.33	17.51	9.18	6.86	4.14	5.45	5.64	5.46	5.59	0.85	5.99	64.65	0	47.88	29.91	8.46
bert-base-uncased	28.29	10.06	8.38	9.08	4.49	2.12	8.4	4.61	5.51	2.84	2.67	4.66	5.89	2.89	5.41	4.13	3.3	2.19	8.26	1.91	4.3	2.62	61.03	2.82	13.34	14.74	0.97
contriever-base-msmarco	48.32	44.49	40.65	51.05	28.84	22.38	39.65	34.94	33.67	29.21	21.15	31.7	34.93	25.04	24.79	38.1	59.29	27.42	56.81	36.77	31.32	41.83	86.72	17.12	65.51	44.77	15.79
glove.6B.300d	36.3	23.39	15.7	27.84	11.19	8.67	21.24	13.49	15.47	12.3	9.08	14.44	17.22	11.13	14.44	18.28	14.99	10.09	19.18	9.6	13.87	12.87	71.32	8.04	29.58	36.22	13.99
gtr-t5-base	50.83	43.3	43.93	52.47	30.68	23.68	36.78	37.58	34.55	28.5	23.35	32.97	34.21	27.15	24.88	35.24	68.93	35.15	54.93	41.16	30.22	50.47	87.98	14	59.74	56.05	25.89
gtr-t5-large	52.09	46.05	46.83	56.34	33.72	24.85	38.47	38.49	36.62	30.44	25.07	35.3	35.66	28.21	26.9	39.55	72.66	42.79	57.85	42.73	32.63	55.09	88.47	15.51	63.42	56.68	28.29
gtr-t5-xl	52.81	44.93	46.48	55.81	34.64	27.42	39.65	39.61	37.35	30.09	26.05	36.63	36.47	30.42	27.01	39.74	72.18	44.19	58.91	43.52	33.34	56.16	88.91	15.71	64.2	60.09	25.26
gtr-t5-xxl	53.77	47.65	47.9	57.47	35.21	27.25	41.33	40.16	38.56	32.02	26.98	38.35	37.41	30.99	27.21	41.28	74.08	46.78	59.67	44.05	34.18	57.24	89.09	15.88	66.77	51.9	26.76
komninos	30.96	24.56	17.58	29.44	12.32	9.54	22.67	15.29	16.79	14.28	9.93	15.15	18.24	12.46	14.87	15.88	15.56	10.49	20.77	9.75	11.79	12.75	71.57	8.47	29.53	35.92	13.17
msmarco-bert-co-condensor	45.15	41.04	32.16	45.07	25.75	16.54	31.07	25.2	27.72	24.23	16.03	27.31	28	20.2	16.96	27.86	45.68	15.62	35.61	29.57	22.29	29.85	86.51	10.13	52.31	40.54	8.57
paraphrase-multilingual-MiniLM-L12-v2	44.88	40.65	35.66	44.33	28.04	21.44	34.74	32.58	30.7	24.64	20.5	32.17	30.7	23.02	18.49	22.63	52.66	20.33	30.01	23.72	23.45	29.8	86.55	0.03	48.37	39.12	16.06
paraphrase-multilingual-mpnet-base-v2	48.91	42.78	35.83	44.84	27.33	22.91	34.89	34.46	31.32	24.95	20.61	31.5	30.66	25.01	15.27	26.22	56.76	22.96	37.03	26.6	25.49	33.6	86.4	13.97	50.3	37.87	17.4
sentence-t5-base	44.85	46.18	37.03	53.95	32.34	24.7	38.8	40.16	35.23	29.37	23.04	34.96	35.64	26.61	10.37	27.77	26.17	34.83	33.2	20.7	28.65	36.32	85.49	14.15	45.76	40.7	20.3
sentence-t5-large	39.27	50.35	42.09	58.4	35.38	27.69	41.91	44.15	38.96	32.4	26.19	39.83	40.97	28.17	11.36	31.55	36.21	43.55	33.95	23.96	31.1	42.02	85.73	15.38	49.91	46.11	21.63
sentence-t5-xl	39.4	51.12	44.77	59.93	37.32	30.63	43.57	45.58	40.78	32.66	27.69	41.81	42.31	31.93	10.61	33.65	36.12	44.71	37.17	25.17	33.18	46.29	85.85	15.97	50.91	54.77	22.51
sentence-t5-xxl	39.85	55.07	49.42	63.46	41.55	33.79	47.72	47.93	44.65	36.23	32.1	46.61	45.67	36.31	14.63	39.19	51.2	46.68	42.14	27.67	35.08	52.87	85.96	17.17	55.38	59.48	21.65
sup-simcse-bert-base-uncased	38.33	21.38	17.63	28	10.33	8.16	19.71	14.68	14.5	11.49	7.73	12.52	13.92	8.41	11.98	19.73	20.41	10.41	22.9	11	12.42	16.08	79.62	7.53	29.59	22.93	9.9
text-embedding-ada-002	57.44	51.26	49.26	59.25	39.84	30.92	45.18	43.44	41.69	33.91	29.97	43.99	39.71	33.57	21.64	39.39	74.99	44.41	60.9	40.91	36.97	51.58	87.6	18.36	72.75	68.47	21.61
text-similarity-ada-001	39.65	17.62	12.07	19.59	8.01	4.7	10.95	9.41	10.17	7.15	4.21	9.79	12.02	6.52	2.83	3.48	4.45	7.54	12.6	10.53	20.59	2.02	82.18	6.28	45.46	24.56	3.1
text-similarity-curie-001		13.05	9.9	15.74			8.23						8.76					5.14			19.96		83.11		46.68	7.61
text-search-ada-001	46.91														18.5	36.2	72.1	38.41	59.39	37.94	33.17	42.81	70.57	14.83	67.25	72.43	28.68
text-search-babbage-001	49.2														19.9		77	42.2	63.1		36.7		69.7		70.4	58.5	29.7
text-search-curie-001	46.98	44.51	47.14												19.4		75.6	45.21	64.8		38.01		67.7	17.74	74.35	56.14	30.9
text-search-davinci-001	43.5														22.3		77.5	51.2	68.8		40.7		63.8		75.4	64.9	29.1
unsup-simcse-bert-base-uncased	38.34	21.33	17.23	25.7	9.91	5.94	18.12	13.8	13.22	9.75	5.42	10.98	13.89	6.61	11.8	15.04	21.06	9.84	19.75	9.35	9.88	11.69	78.03	5.5	25.72	26.2	8.9
SGPT-1.3B-weightedmean-msmarco-specb-bitfit	49.68	41.47	39.77	49.66	30.35	23.38	39.04	35.73	33.33	27.8	21.24	32.46	33.38	25.64	26.6	31.51	68.12	29.99	49.93	36.05	32.08	42.94	85.28	16.18	68.29	72.98	24.45
SGPT-125M-weightedmean-msmarco-specb-bitfit	45.42	33.37	31.69	39.8	25.11	19.43	32.32	28.83	27.25	24.52	16.82	25.37	27.25	22.47	21.86	22.72	60.45	21.12	40.88	27.98	22.79	29.73	72.98	12.21	56.9	70.3	22.97
SGPT-125M-weightedmean-nli-bitfit	31.04	28.72	18.8	33.34	17.32	14.48	23.11	20.62	20.29	17.69	11.24	20.3	22.77	15.09	11.01	10.87	18.4	8.94	17.73	6.27	11.8	7.63	78.96	7.13	31.79	39.31	12.27
SGPT-2.7B-weightedmean-msmarco-specb-bitfit	50.49	46.69	42.41	53.68	33.97	24.04	43.01	37.94	36.53	31.01	24.4	35.32	37.2	28.75	27.11	34.7	72.73	33.29	52.84	38.83	33.89	46.7	85.6	16.57	70.17	75.17	23.44
SGPT-5.8B-weightedmean-msmarco-specb-bitfit	51.38	47.67	46.38	55.83	36.95	28.63	45.57	41.48	39.4	33.4	26.81	38.74	39.57	31.82	30.46	39.87	78.24	37.2	59.26	39.91	36.21	52.41	84.58	19.87	74.7	84.88	25.43
SGPT-5.8B-weightedmean-nli-bitfit	35.07	40.35	31.61	45.07	24.89	20.98	35.22	30.91	29.98	25.14	18.77	30.64	32.42	23.75	17.57	26.1	38.64	18.59	33.99	15.83	28.26	24.63	84.68	13.55	46.66	55.35	16.18
sgpt-bloom-7b1-msmarco	47.28	47.68	46.29	56.68	37.04	26.48	45.61	40.53	39.62	35.44	28.23	38.41	40.85	32.22	29.39	39.03	73.97	35.84	57.26	41.12	35.78	53.15	74.71	18.62	72.11	81.37	23.98
e5-small	46.69	45.78	42.99	53.31	33.7	24.39	40.54	36.79	36.08	30.9	26.46	34.27	34.98	28.86	15.81	38.64	53.52	34.8	56.34	42.33	33.93	58.73	87.71	16.42	65.6	76.78	26.81
instructor-large	57.05	55.9	50.77	63.07	39.51	30.66	47.82	47.45	43.82	34.62	30.03	44.68	46.39	34.91	27.74	36.68	72.69	45.45	55.18	39.65	34.09	50.1	88.44	18.55	64.43	58.06	21.56
instructor-base	52.03	52.61	47.18	58.84	38.47	28.28	44.22	45.3	40.95	33.1	28.2	40.36	42.82	32.02	27.95	33.34	71.85	39.18	54.19	37.76	31.59	45.88	88.19	17.09	57.83	58.55	20.37
instructor-xl	55.65	54.99	49.32	63.36	40.58	30.84	45.28	44.9	43.09	35.65	29.09	42.52	45.14	35.47	26.54	40.24	70.03	46.96	55.88	41.61	36	57.24	88.85	17.36	64.56	71.4	23.44
e5-base	51.41	45.61	45.72	55.03	37.28	28.26	42.91	40.82	38.92	33.73	29.68	38.31	36.52	33.18	15.38	41.02	58.24	36.37	62.21	43.14	36.59	59.97	87.92	18.99	73.08	79.64	28.31
e5-large	49.35	46.85	47.18	57.41	36.97	28.95	43.5	39.97	39.44	33.36	30.15	38.57	37.96	32.45	22.4	42.39	65.03	38.56	63.33	44.05	36.07	62.86	88.18	20.12	72.58	78.32	27.21
e5-small-v2	41.67	45.09	42.04	55.69	34.64	25.15	40.42	39.47	37.07	32.53	25.97	35.97	36.61	31.24	22.87	41.32	81.64	37.43	66.61	41.46	32.45	59.11	85.71	17.77	68.85	74.53	27.12
e5-base-v2	44.49	50.38	42.9	57.59	35.62	26.27	41.78	41.17	38.54	32.82	25.89	37.71	40.59	29.81	26.56	42.23	84.99	39.88	69.15	41.77	35.39	58.22	86.56	18.69	71.94	69.6	26.4
e5-large-v2	46.42	50.27	42.69	57.28	35.2	25.83	41.34	39.97	37.89	31.06	25.15	38.35	39.36	28.19	22.21	44.02	82.83	41.14	73.13	43.46	37.13	63.44	86.84	20.51	72.24	66.54	20.67
multilingual-e5-base	44.23	47.83	44.06	59.2	34.93	27.03	41.58	40.7	38.52	32.59	27.31	36.73	39.21	31.11	23.86	40.36	79.44	38.17	68.56	42.27	32.46	60.02	87.65	17.16	69.35	69.76	21.35
text2vec-base-multilingual																							83.07
cai-lunaris-text-embeddings	37.27	23.63	26.09	33.34	13.88	9.67	23.39	19.67	18.81	16.03	10.2	17.25	21.07	11.56	8.69	14.77
cai-stellaris-text-embeddings	47.29	36.16	40.7	44.83	27.45	22.98	35.55	30.3	31.03	25.27	22.2	30.15	31.39	25.37	13.48	22.45
multilingual-e5-small	39.06								36.07						22.55	37.76	75.27	33.31	65.09	40.99	31.01	56.29	86.93	13.89	67.7	72.57	21.16
multilingual-e5-large	54.38								39.68						25.73	41.29	82.81	43.8	71.23	43.7	33.99	64.06	88.18	17.47	70.41	71.33	23.39
jina-embedding-s-en-v1	45.18														16.62	26.72	61.24	26.65	43.1	29.7	25.13	37.97	85.62	15.15	53.59	50.63	20.08
jina-embedding-b-en-v1	49.35														20.78	31.35	67.59	35.48	49.64	33.02	29.3	43.61	87.07	17.71	58.6	54.63	18.06